lzhengning
/
nccl-tests
mirror of https://github.com/NVIDIA/nccl-tests.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

doc: add all2all factor

This commit is contained in:
Oren 2024-07-24 22:55:00 -04:00 committed by GitHub
parent d028efcf35
commit c6eb15875f
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
doc/PERFORMANCE.md
View File

@ -140,5 +140,6 @@ To obtain a bus bandwidth which should be independent of the number of ranks _n_
* AllGather : (_n_-1)/_n_
* Broadcast : 1
* Reduce : 1
* AlltoAll: (_n_-1)/_n_
The bus bandwidth should reflect the speed of the hardware bottleneck : NVLink, PCI, QPI, or network.