Structured Packing in LLM Training Improves Long Context Utilization
AAAI 2025（2025）
Key words
LLM,long-context,pretraining,context utilization,NLP,language models,data mixtures
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined