Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
Bo Peng, Daniel Goldstein,Quentin Anthony,Alon Albalak,Eric Alcaide,Stella Biderman,Eugene Cheah,Xingjian Du,Teddy Ferdinan,Haowen Hou,Przemysław Kazienko,Kranthi Kiran GV,Jan Kocoń,Bartłomiej Koptyra,Satyapriya Krishna, Ronald McClelland Jr.,Jiaju Lin,Niklas Muennighoff, Fares Obeid,Atsushi Saito,Guangyu Song,Haoqin Tu, Cahya Wirawan,Stanisław Woźniak, Ruichong Zhang,Bingchen Zhao,Qihang Zhao, Peng Zhou,Jian Zhu,Rui-Jie Zhu COLM 2024(2024)
AI Read Science
Must-Reading Tree
Example

Generate MRT to find the research sequence of this paper