Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

31,188

Base only

Active filters: 8-bit

deepseek-ai/DeepSeek-V4-Pro-DSpark

Text Generation • 889B • Updated 6 days ago • 33.1k • 463

nvidia/Qwen3.6-27B-NVFP4

Text Generation • 18B • Updated 10 days ago • 788k • 334

nvidia/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4

Text Generation • 45B • Updated 3 days ago • 23.4k • 94

deepseek-ai/DeepSeek-V4-Flash-DSpark

Text Generation • 165B • Updated 6 days ago • 133k • 182

nvidia/GLM-5.2-NVFP4

Text Generation • 381B • Updated 14 days ago • 737k • 258

deepseek-ai/DeepSeek-V4-Pro

Text Generation • 862B • Updated 18 days ago • 1.32M • • 5.19k

madeby561/GLM-5.2-MXFP8-NVFP4-NF3-Hybrid

347B • Updated about 17 hours ago • 2.48k • 36

deepseek-ai/DeepSeek-V4-Flash

Text Generation • 158B • Updated 18 days ago • 2.52M • • 1.72k

nvidia/Qwen3.6-35B-A3B-NVFP4

Text Generation • 19B • Updated 28 days ago • 8.2M • 452

openai/gpt-oss-120b

Text Generation • 120B • Updated Aug 26, 2025 • 4.41M • • 4.96k

AEON-7/Ornith-1.0-35B-AEON-Ultimate-Uncensored-NVFP4

Text Generation • 21B • Updated 11 days ago • 37.9k • 50

RedHatAI/GLM-5.2-NVFP4-FP8

Text Generation • 425B • Updated about 20 hours ago • 701 • 17

sakamakismile/ThinkingCap-Qwen3.6-27B-NVFP4

Image-Text-to-Text • 17B • Updated 2 days ago • 889 • 15

openai/gpt-oss-20b

Text Generation • 22B • Updated Aug 26, 2025 • 7.38M • • 4.78k

meituan-longcat/LongCat-2.0-INT8

Text Generation • 1.8T • Updated 2 days ago • 182 • 14

PhalaCloud/GLM-5.2-W4AFP8

Text Generation • 392B • Updated 2 days ago • 33.7k • 37

google/gemma-4-E2B-it-qat-mobile-transformers

Any-to-Any • 2B • Updated about 3 hours ago • 25.7k • 120

nvidia/Qwen3.5-122B-A10B-NVFP4

Text Generation • 65B • Updated Jun 2 • 101k • 38

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4

Text Generation • 335B • Updated 16 days ago • 407k • • 245

nvidia/MiniMax-M3-NVFP4

Text Generation • 247B • Updated 14 days ago • 150k • 58

kodelow/Hy3-NVFP4-W4A16

Text Generation • 172B • Updated 3 days ago • 3.41k • 10

nvidia/DeepSeek-V4-Flash-NVFP4

Text Generation • 167B • Updated 25 days ago • 693k • 65

nvidia/diffusiongemma-26B-A4B-it-NVFP4

Text Generation • 14B • Updated 6 days ago • 1.97M • 98

nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4

Text Generation • 67B • Updated May 1 • 1.52M • 384

nvidia/Gemma-4-26B-A4B-NVFP4

Text Generation • 14B • Updated May 11 • 1.82M • 114

rdtand/Ornith-1.0-35B-PrismaAURA-4.75bit-vllm-MTP

Text Generation • 22B • Updated 5 days ago • 2.93k • 6

microsoft/bitnet-b1.58-2B-4T

Text Generation • 0.8B • Updated Dec 17, 2025 • 9.18k • 1.48k

OpenYourMind/GLM-5.2-abliterated

432B • Updated 11 days ago • 2 • 24

RedHatAI/GLM-5.2-NVFP4

Text Generation • 426B • Updated 10 days ago • 379 • 6

nvidia/Mistral-Medium-3.5-128B-NVFP4

Text Generation • 84B • Updated 9 days ago • 16.6k • 21