Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

speculative-decoding

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

949

Base only

Active filters: speculative-decoding

mlx-community/Qwen3.5-9B-MTP-4bit

Text Generation • 38M • Updated Jun 1 • 1.08k • 2

mlx-community/Qwen3.6-27B-MTP-bf16

Text Generation • 0.4B • Updated Jun 1 • 1.31k • 2

mlx-community/Qwen3.6-27B-MTP-5bit

Text Generation • 79.7M • Updated Jun 1 • 940 • 1

mlx-community/Qwen3.6-35B-A3B-MTP-4bit

Text Generation • 0.1B • Updated Jun 1 • 2.09k • 3

bytkim/Qwen3.6-27B-MTP-pi-tune-GGUF

Text Generation • 27B • Updated 25 days ago • 106k • 120

Inferact/MiniMax-M3-EAGLE3

Text Generation • 3B • Updated 27 days ago • 24.7k • 12

AngelSlim/Gpt-oss-20b-dflare

Text Generation • 0.8B • Updated Jun 4 • 20 • 1

mradermacher/OYM-Qimi-122B-A10B-K2.6-i1-GGUF

125B • Updated 7 days ago • 1.96k • 5

Janvitos/gemma-4-12B-it-qat-assistant-MTP-Q8_0-GGUF

0.4B • Updated Jun 6 • 23.1k • 35

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Balance

Text Generation • 8B • Updated Jun 7 • 1.44k • 5

Youssofal/Qwen3.5-9B-MTPLX-Optimized-Speed

Text Generation • 9B • Updated 28 days ago • 2.23k • 3

plunderstruck/Qwen3.6-27B-MTP-ROCmFP4-GGUF

0.5B • Updated 19 days ago • 7.6k • 26

amaranus/Gemma-4-E4B-it-qat-assistant-MTP-Q8_0-GGUF

78M • Updated 27 days ago • 870 • 2

ddalcu/Qwen3.6-27B-4bit-MTP-MLX-Serve

Text Generation • 5B • Updated 29 days ago • 764 • 2

trohrbaugh/gemma-4-31b-it-heretic-ara-NVFP4

Image-Text-to-Text • 22B • Updated 29 days ago • 639 • 1

plunderstruck/Qwen3.6-40B-Deckard-MTP-ROCmFP4-GGUF

0.5B • Updated 19 days ago • 13.3k • 7

bytkim/Qwen3.6-27B-MTP-pi-reasoning-GGUF

Image-Text-to-Text • 27B • Updated 19 days ago • 27.2k • 48

speakleash/Bielik-Minitron-7B-v3.0-DFlash

Text Generation • 1.0B • Updated 17 days ago • 7.99k • 5

z-lab/Qwen3.5-397B-A17B-DFlash

Text Generation • 1B • Updated 25 days ago • 7.03k • 8

sakamakismile/gemma-4-12B-coder-fable5-composer2.5-MTP-NVFP4

Text Generation • 7B • Updated 24 days ago • 6.69k • 49

YTan2000/Qwen3.6-27B-MTP-TQ3_4S

Text Generation • 27B • Updated 21 days ago • 3.91k • 20

SixVolts/Qwen3.5-122B-A10B-Opus-Reasoning-MTP-GGUF

122B • Updated 21 days ago • 1.51k • 2

avlp12/GLM-5.2-Alis-MLX-Dynamic-2.56bpw

Text Generation • 743B • Updated about 10 hours ago • 5.31k • 1

nerkyor/Qwen3.6-27B-DSV4Pro-Thinking-Distill-FP8

Text Generation • 28B • Updated 12 days ago • 574 • 5

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-MLX-MTP-Drafter

0.4B • Updated 12 days ago • 3.65k • 2

bleysg/Qwen3.5-122B-A10B-int4-fp8-hybrid

Text Generation • 20B • Updated 16 days ago • 39.9k • 2

sant1an/GLM-5.2-NVFP4-MTP

Text Generation • Updated 15 days ago • 97 • 2

novita/kimi-k2.7-code-eagle3-mla

Text Generation • 2B • Updated 10 days ago • 606 • 2

s-batman/Ornith-1.0-9B-NVFP4-MTP-GGUF

Text Generation • 9B • Updated 11 days ago • 10.6k • 4

fraserprice/DeepSeek-V4-Flash-Abliterated-DSpark

165B • Updated 9 days ago • 2.28k • 7