In-network reductions on multi-dimensional HyperX

2021 IEEE Symposium on High-Performance Interconnects (HOTI)(2021)

引用 3|浏览16
暂无评分
摘要
The use of massively parallel systems for application scaling has pushed the performance bottleneck towards data communication on the network. This is especially critical for allreduce collective that exhibits an all-to-all communication pattern. In this paper, we present an approach for developing performance optimized in-network allreduce on a multi-dimensional HyperX network. Specifically, we d...
更多
查看译文
关键词
In-network Collectives,Allreduce,HyperX
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要