MiniMax-01: Scaling Foundation Models with Lightning Attention
Paper
•
2501.08313
•
Published
•
300
LLM Architecture
-
-
Scalable-Softmax Is Superior for Attention
Paper • 2501.19399 • Published • 24 -
FastKV: Decoupling of Context Reduction and KV Cache Compression for Prefill-Decoding Acceleration
Paper • 2502.01068 • Published • 18 -
Scaling Embedding Layers in Language Models
Paper • 2502.01637 • Published • 24 -
Taming the Titans: A Survey of Efficient LLM Inference Serving
Paper • 2504.19720 • Published • 12 -
EmbeddingGemma: Powerful and Lightweight Text Representations
Paper • 2509.20354 • Published • 47