DySpec: Faster Speculative Decoding with Dynamic Token Tree Structure
World Wide Web(2025)
Key words
Artificial intelligence,Large language models,Inference acceleration,Speculative decoding
AI Read Science
Must-Reading Tree
Example

Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined