Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

821

Base only

Active filters: ggml

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 273k • 520

unsloth/FLUX.2-dev-GGUF

Image-to-Image • 32B • Updated Dec 10, 2025 • 14.6k • 78

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 148k • 186

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 100k • 277

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 46.2k • 238

Serveurperso/ACE-Step-1.5-GGUF

0.7B • Updated Apr 14 • 40.9k • 82

unsloth/ERNIE-Image-Turbo-GGUF

Text-to-Image • 8B • Updated Apr 14 • 7.55k • 227

Serveurperso/Qwen3-TTS-GGUF

Text-to-Speech • 0.9B • Updated May 11 • 66.9k • 29

ilintar/trellis2-gguf

Image-to-3D • 0.2B • Updated 25 days ago • 9.03k • 5

unsloth/Qwen-Image-Layered-GGUF

Image-Text-to-Image • 20B • Updated Jan 9 • 11.6k • 61

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated Apr 30 • 44.2k • 39

mudler/parakeet-cpp-gguf

Automatic Speech Recognition • 0.6B • Updated Jun 6 • 21.7k • 63

malteos/bloom-6b4-clp-german

Text Generation • 6B • Updated Apr 6, 2024 • 113 • 38

unsloth/FLUX.2-klein-base-9B-GGUF

Image-to-Image • 9B • Updated Jan 15 • 9.27k • 38

richiejp/deepvqe-aec-gguf

Audio-to-Audio • 7.97M • Updated Apr 27 • 188 • 3

bleckhert/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Mar 21 • 1.52k • 1

cstr/parakeet-tdt-0.6b-v3-GGUF

Automatic Speech Recognition • 0.6B • Updated 11 days ago • 4.33k • 9

cstr/qwen3-forced-aligner-0.6b-GGUF

Automatic Speech Recognition • 0.9B • Updated Apr 11 • 1.83k • 4

cstr/pyannote-v3-segmentation-GGUF

Voice Activity Detection • 1.49M • Updated Apr 12 • 142 • 1

unsloth/ERNIE-Image-GGUF

Text-to-Image • 8B • Updated Apr 14 • 1.9k • 70

LocalAI-io/LocalVQE

Audio-to-Audio • 578k • Updated about 1 month ago • 6.24k • 63

cstr/glm-asr-nano-GGUF

Automatic Speech Recognition • 2B • Updated 13 days ago • 3.04k • 2

cstr/vibevoice-asr-GGUF

Automatic Speech Recognition • 8B • Updated 21 days ago • 5.79k • 6

cstr/omniASR-CTC-300M-v2-GGUF

Automatic Speech Recognition • 0.3B • Updated Apr 26 • 95 • 1

mudler/vibevoice.cpp-models

Updated Apr 28 • 16k • 12

cstr/qwen3-tts-tokenizer-12hz-GGUF

Audio-to-Audio • 0.2B • Updated Apr 29 • 2.81k • 2

cstr/qwen3-tts-1.7b-base-GGUF

Text-to-Speech • 2B • Updated May 1 • 1.65k • 6

cstr/snac-24khz-GGUF

Text-to-Speech • 13.1M • Updated 29 days ago • 613 • 2

Nic22Of2003/Qwen3.5-2B-Uncensored-HauhauCS-Aggressive-IQ4_NL

Text Generation • 2B • Updated May 10 • 516 • 2

mudler/locate-anything.cpp-gguf

Object Detection • 4B • Updated Jun 11 • 5.84k • 9