M2R2: Mixture of Multi-Rate Residuals for Efficient Transformer Inference Paper • 2502.02040 • Published Feb 4 • 2
Speculative Streaming: Fast LLM Inference without Auxiliary Models Paper • 2402.11131 • Published Feb 16, 2024 • 42
