Chrome Extension
WeChat Mini Program
Use on ChatGLM

HOBBIT: A Mixed Precision Expert Offloading System for Fast MoE Inference

Peng Tang, Jiacheng Liu,Xiaofeng Hou, Yifei Pu,Jing Wang,Pheng-Ann Heng,Chao Li,Minyi Guo

CoRR(2024)

Cited 0|Views7
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined