Never Train from Scratch: Fair Comparison of Long-Sequence Models Requires Data-Driven Priors
ICLR 2024（2024）
Key words
Pre Training,Transformers,State Space Models,Long Range Models,Fair Evaluation
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined