NCCL

E209960

NCCL (NVIDIA Collective Communications Library) is a high-performance library that optimizes multi-GPU and multi-node communication for deep learning and HPC applications.

All labels observed (3)

Label Occurrences
NCCL canonical 2
NVIDIA Collective Communications Library 1
NVIDIA NCCL 1

How this entity was disambiguated

Statements (66)

Predicate Object
instanceOf GPU communication library
collective communications library
communication library
parallel computing library
developer NVIDIA Corporation
surface form: NVIDIA
domain deep learning
distributed training
high-performance computing
multi-GPU computing
multi-node computing
feature GPUDirect RDMA support
asynchronous communication API
grouped collective operations
hierarchical collectives
multi-process communication support
ring-based collectives
topology-aware communication algorithms
tree-based collectives
fullName NCCL self-linksurface differs
surface form: NVIDIA Collective Communications Library
goal high-bandwidth GPU communication
low-latency collective operations
scalable multi-GPU training
integratesWith NVIDIA CUDA
surface form: CUDA
license BSD-style license
optimizedFor GPU interconnects
Nvidia Maxwell GPU
surface form: NVIDIA GPUs
primaryAPIStyle C API
programmingLanguage C
provider NVIDIA Corporation
surface form: NVIDIA
requires CUDA-enabled GPU
supportsDataType bfloat16
float16
float32
float64
int32
int64
uint8
supportsEnvironment cloud GPU clusters
on-premise clusters
supportsHardware Ethernet
InfiniBand
NVLink interconnect
surface form: NVLink

NVLink interconnect
surface form: NVSwitch

PCI Express
surface form: PCIe
supportsLanguageBinding C++
Python
supportsOperation all-gather
all-reduce
broadcast
gather
reduce
reduce-scatter
scatter
supportsReductionOp max
min
product
sum
supportsTopology multi-node multi-GPU
single-node multi-GPU
targetUser HPC developers
deep learning framework developers
usedBy DeepSpeed
Horovod
Megatron-LM
PyTorch
surface form: PyTorch distributed

TensorFlow distributed training

How these facts were elicited

Referenced by (4)

Full triples — surface form annotated when it differs from this entity's canonical label.

NVIDIA CUDA includes NCCL
NVIDIA Tesla data center GPUs supportsEcosystem NCCL
this entity surface form: NVIDIA NCCL
NCCL fullName NCCL self-linksurface differs
this entity surface form: NVIDIA Collective Communications Library
Compute Unified Device Architecture includesLibrary NCCL
subject surface form: CUDA