Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13,075

Base only

Active filters: quantized

orabazes/Flux-Krea-GGUF

12B • Updated Jul 31, 2025 • 45 • 5

VincentGOURBIN/voxtral-small-4bit-mixed

Automatic Speech Recognition • 25B • Updated Jul 31, 2025 • 154

VincentGOURBIN/voxtral-small-8bit

Automatic Speech Recognition • 25B • Updated Jul 31, 2025 • 42

sp-embraceable/e2-llama-v3p3-70B-Merged-v1-LQ

Text Generation • Updated Jul 31, 2025

LibraxisAI/svetliq-11b-v3-evolutionary-preview-mlx-q8

Text Generation • 11B • Updated Apr 27 • 6

NVFP4/Qwen3-30B-A3B-Instruct-2507-FP4

Text Generation • 16B • Updated Aug 1, 2025 • 2.43k • 11

JahnaviBhansali/person-classification-tflite

Image Classification • Updated Aug 1, 2025 • 6 • 1

NVFP4/Qwen3-30B-A3B-Thinking-2507-FP4

Text Generation • 16B • Updated Aug 1, 2025 • 993 • 4

steampunque/QwQ-32B-MP-GGUF

33B • Updated Feb 18 • 9 • 3

SandLogicTechnologies/MedScholar-1.5B-GGUF

Text Generation • 2B • Updated Aug 1, 2025 • 6 • 1

RedHatAI/gemma-3n-E4B-it-FP8-dynamic

Text Generation • 8B • Updated Apr 28 • 229 • 4

ggml-org/gpt-oss-120b-GGUF

Text Generation • 117B • Updated 4 days ago • 21.7k • 75

ramblingpolymath/Qwen3-1.7B-W8A8

Text Generation • 2B • Updated Aug 3, 2025 • 13

ramblingpolymath/Qwen3-30B-A3B-Instruct-2507-W4A16

Text Generation • 31B • Updated Aug 3, 2025 • 11

ramblingpolymath/Qwen3-Coder-30B-A3B-Instruct-W4A16

Text Generation • 31B • Updated Aug 3, 2025 • 29 • 2

ramblingpolymath/Qwen3-30B-A3B-Thinking-2507-W4A16

Text Generation • 31B • Updated Aug 3, 2025 • 7 • 3

steampunque/Qwen3-Coder-30B-A3B-Instruct-MP-GGUF

31B • Updated May 5 • 104 • 2

NVFP4/Qwen3-Coder-30B-A3B-Instruct-FP4

Text Generation • 16B • Updated Aug 5, 2025 • 19.3k • 36

pythn/intent-classification-onnx-quantized

Updated Aug 5, 2025

steampunque/Qwen3-30B-A3B-Instruct-2507-MP-GGUF

31B • Updated Feb 18 • 25 • 1

steampunque/Qwen3-30B-A3B-Thinking-2507-MP-GGUF

31B • Updated Feb 18 • 16 • 1

AlekseyCalvin/QWEN_IMAGE_fp4_w_AbliteratedTE_Diffusers

Text-to-Image • 11B • Updated Aug 6, 2025 • 77 • 9

daskalos-apps/phi4-cybersec-Q4_K_M

4B • Updated Aug 6, 2025 • 19

helizac/dots.ocr-4bit

Image-to-Text • 3B • Updated Aug 6, 2025 • 21 • 31

steampunque/gpt-oss-20b-MP-GGUF

21B • Updated Feb 20 • 28 • 1

Ju214/Mistral-Small-24B-3.1

Image-Text-to-Text • 24B • Updated Aug 7, 2025 • 2

Jacaranda-Health/ASR-STT-4bit

Automatic Speech Recognition • 0.8B • Updated Aug 15, 2025 • 6 • 1

NVFP4/Qwen3-0.6B-FP4

Text Generation • 0.4B • Updated Aug 10, 2025 • 70 • 2

HillPhelmuth/gpt-oss-20B-chess-analysis-GGUF

21B • Updated Aug 11, 2025 • 7

tachytelicdetonation/medgemma-27b-it-fp8-dynamic

Text Generation • 27B • Updated Aug 11, 2025 • 20