nccl missing on centos7 containers but present on ubuntu containers
Consider the comparison between ubuntu and centos containers:
% docker run -it nvidia/cuda:10.2-cudnn7-devel-ubuntu18.04 /bin/bash
Unable to find image 'nvidia/cuda:10.2-cudnn7-devel-ubuntu18.04' locally
10.2-cudnn7-devel-ubuntu18.04: Pulling from nvidia/cuda
7ddbc47eeb70: Pull complete
c1bbdc448b72: Pull complete
8c3b70e39044: Pull complete
45d437916d57: Pull complete
d8f1569ddae6: Pull complete
902fc5ce8229: Pull complete
ae1bb79c5cfc: Pull complete
fa6605c8fe7a: Pull complete
0508a679d339: Pull complete
b146e75a4883: Pull complete
Digest: sha256:d3f5d6e8fe105dadb55aef7c80191d6281bbd18989a05124b108b7c8a522a5ad
Status: Downloaded newer image for nvidia/cuda:10.2-cudnn7-devel-ubuntu18.04
root@5e707c6aeadc:/# find /usr/ -name "*nccl*"
/usr/include/nccl.h
/usr/share/doc/libnccl-dev
/usr/share/doc/libnccl2
/usr/lib/x86_64-linux-gnu/libnccl.so
/usr/lib/x86_64-linux-gnu/libnccl_static.a
/usr/lib/x86_64-linux-gnu/libnccl.so.2
/usr/lib/x86_64-linux-gnu/libnccl.so.2.5.6
root@5e707c6aeadc:/# find /usr/ -name "*nccl*"^C
root@5e707c6aeadc:/# exit
% docker run -it nvidia/cuda:10.2-cudnn7-devel-centos7 /bin/bash
Unable to find image 'nvidia/cuda:10.2-cudnn7-devel-centos7' locally
10.2-cudnn7-devel-centos7: Pulling from nvidia/cuda
ab5ef0e58194: Already exists
c9fcd75aa85e: Already exists
8ff47b5afaab: Already exists
66d90780bff5: Pull complete
42d4038c8406: Pull complete
dc73c0f38d0f: Pull complete
f54d3da29cc8: Pull complete
b6a626c69094: Pull complete
Digest: sha256:b8631d58b1123f484fca3fcbc22dd88b0dfb1e8676bdd2a871e060bce40ff264
Status: Downloaded newer image for nvidia/cuda:10.2-cudnn7-devel-centos7
[root@465302efd8e4 /]# find /usr/ -name "*nccl*"
[root@465302efd8e4 /]#