Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

626

Base only

Active filters: compression

exnivo/Qwen3.8-20B-Minitron

Image-Text-to-Text • 20B • Updated 11 days ago • 2.65k • 7

cerebras/GLM-4.5-Air-REAP-82B-A12B

Text Generation • 82B • Updated Oct 21, 2025 • 177 • 115

samuelfaj/distill-1.7B-MLX

Text Generation • 2B • Updated May 14 • 63 • 3

Miltos22/Qwen3.8-20B-Minitron-Q3_K_S-GGUF

Image-Text-to-Text • 19B • Updated 10 days ago • 764 • 1

logic65/Qwen3.8-Whittle-tri-14.7B

Text Generation • 15B • Updated 9 days ago • 2.67k • 1

turintech/GLM-5.2-MaxMin108-GGUF

Text Generation • 325B • Updated 10 days ago • 925 • 5

ewinregirgojr/Qwen3.8-9B-Instruct-Turbo

Text Generation • 12B • Updated about 7 hours ago • 1

ecyas/Qwen3.8-9B-Instruct-Turbo-Q5_K_M-GGUF

Text Generation • 11B • Updated about 13 hours ago • 1

RedHatAI/oBERT-teacher-squadv1

Updated Jul 31, 2022 • 42

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-squadv1

Updated Jul 31, 2022 • 38

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-squadv1

Updated Jul 31, 2022 • 36

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-squadv1

Updated Jul 31, 2022 • 31

RedHatAI/oBERT-teacher-mnli

Updated Jul 31, 2022 • 39

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-mnli

Updated Jul 31, 2022 • 31

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-mnli

Updated Jul 31, 2022 • 31

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-mnli

Updated Jul 31, 2022 • 34

RedHatAI/oBERT-teacher-qqp

Updated Jul 31, 2022 • 51

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-qqp

Updated Jul 31, 2022 • 32

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-qqp

Updated Jul 31, 2022 • 29

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-qqp

Updated Jul 31, 2022 • 33

RedHatAI/oBERT-12-upstream-pretrained-dense

Updated Jul 31, 2022 • 36

RedHatAI/oBERT-6-upstream-pretrained-dense

Updated Jul 31, 2022 • 36

RedHatAI/oBERT-3-upstream-pretrained-dense

Updated Jul 31, 2022 • 33

RedHatAI/oBERT-12-upstream-pruned-unstructured-90

Updated Jul 31, 2022 • 30

RedHatAI/oBERT-12-upstream-pruned-unstructured-97

Updated Jul 31, 2022 • 40

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-squadv1

Updated Jul 31, 2022 • 38

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-squadv1

Updated Jul 31, 2022 • 36

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-mnli

Updated Jul 31, 2022 • 46

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-mnli

Updated Jul 31, 2022 • 37

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-qqp

Updated Jul 31, 2022 • 43