Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

670

Base only

Active filters: ggml

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 313k • 437

mudler/parakeet-cpp-gguf

Automatic Speech Recognition • 0.6B • Updated 4 days ago • 2.41k • 13

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 108k • 226

mudler/rfdetr-cpp-nano

Object Detection • 29.5M • Updated 7 days ago • 515 • 8

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 54.6k • 198

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 169k • 153

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated Apr 30 • 14.4k • 22

unsloth/FLUX.2-dev-GGUF

Image-to-Image • 32B • Updated Dec 10, 2025 • 15.9k • 64

unsloth/Z-Image-GGUF

Text-to-Image • 6B • Updated Jan 28 • 17.5k • 171

unsloth/ERNIE-Image-Turbo-GGUF

Text-to-Image • 8B • Updated Apr 14 • 28k • 215

unsloth/FLUX.2-klein-base-4B-GGUF

Image-to-Image • 4B • Updated Jan 15 • 2.49k • 23

m1el/nemotron-speech-streaming-0.6B-gguf

Automatic Speech Recognition • 0.6B • Updated Jan 30 • 474 • 3

wabisabisocial/whisper-base-french-ggml

Updated Feb 3 • 1

Serveurperso/ACE-Step-1.5-GGUF

0.7B • Updated Apr 14 • 47.8k • 65

cstr/canary-ctc-aligner-GGUF

Automatic Speech Recognition • 0.6B • Updated Apr 8 • 967 • 1

LocalAI-io/LocalVQE

Audio-to-Audio • 1.29M • Updated 5 days ago • 2.78k • 36

cstr/vibevoice-asr-GGUF

Automatic Speech Recognition • 8B • Updated 21 days ago • 2.1k • 3

cstr/mimo-asr-GGUF

Automatic Speech Recognition • 8B • Updated May 2 • 969 • 6

mudler/vibevoice.cpp-models

Updated Apr 28 • 29.8k • 10

cstr/qwen3-tts-1.7b-base-GGUF

Text-to-Speech • 2B • Updated May 1 • 589 • 1

Serveurperso/Qwen3-TTS-GGUF

Text-to-Speech • 0.9B • Updated 22 days ago • 4.05k • 2

mudler/rfdetr-cpp-seg-small

Image Segmentation • 33.5M • Updated 7 days ago • 176 • 1

unsloth/FLUX.2-klein-base-9B-GGUF

Image-to-Image • 9B • Updated Jan 15 • 12.4k • 34

malteos/bloom-6b4-clp-german

Text Generation • 6B • Updated Apr 6, 2024 • 1.19k • 37

nouamanetazi/bloomz-560m-ggml

Updated Mar 15, 2023 • 4

maximeseth/alpaca-native-7B-ggml

Updated Mar 26, 2023 • 5 • 1

bertin-project/bertin-gpt-j-6B-alpaca

Text Generation • 6B • Updated Nov 10, 2024 • 984 • 7

CRD716/ggml-LLaMa-65B-quantized

Text Generation • Updated Sep 9, 2023 • 30

CRD716/ggml-vicuna-1.1-quantized

Text Generation • Updated Sep 9, 2023 • 43

Drake-AI/GPT-J-6b-Skein-ggml-q4_1

Updated Apr 18, 2023 • 1