Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning

Wei An,Xiao Bi,Guanting Chen,Shanhuang Chen,Chengqi Deng,Honghui Ding,Kai Dong, Qiushi Du,Wenjun Gao,Kang Guan,Jianzhong Guo,Yongqiang Guo, Zhe Fu, Ying He,Panpan Huang,Jiashi Li,Wenfeng Liang, Xiaodong Liu, Xin Liu,Yiyuan Liu,Yuxuan Liu,Shanghao Lu, Xuan Lu,Xiaotao Nie,Tian Pei,Junjie Qiu,Hui Qu,Zehui Ren,Zhangli Sha,Xuecheng Su,Xiaowen Sun,Yixuan Tan,Minghui Tang, Shiyu Wang,Yaohui Wang, Yongji Wang,Ziwei Xie,Yiliang Xiong, Yanhong Xu,Shengfeng Ye,Shuiping Yu,Yukun Zha,Liyue Zhang, Haowei Zhang,Mingchuan Zhang, Wentao Zhang,Yichao Zhang,Chenggang Zhao,Yao Zhao,Shangyan Zhou,Shunfeng Zhou,Yuheng Zou

SC24 International Conference for High Performance Computing, Networking, Storage and Analysis（2024）

引用 0|浏览32

关键词

High Performance Computing,Cost-Effective,All-Reduce,Best Practices,Deep Learning,Machine Learning,Large Language Models,Artificial Intelligence Infrastructure

AI 理解论文

溯源树

样例

生成溯源树，研究论文发展脉络

Chat Paper

正在生成论文摘要