Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9

Base only

Active filters: qwen2_5

RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8

Text Generation • 8B • Updated Jun 9 • 960 • 2

RedHatAI/Qwen2.5-7B-Instruct-FP8-dynamic

Text Generation • 8B • Updated Jun 9 • 2.28k • 1

RedHatAI/Qwen2.5-7B-Instruct-quantized.w4a16

Text Generation • 8B • Updated Aug 5 • 296 • 1

RedHatAI/Qwen2.5-7B-Instruct

Text Generation • 8B • Updated Jun 9 • 23 •

Levelfive/qwen2.5-coder-7b-instruct-q4km-only

Text Generation • 8B • Updated Dec 16, 2025 • 474

Levelfive/qwen2.5-coder-7b-instruct-q4km-complete

Text Generation • 8B • Updated Dec 16, 2025 • 17

pakajoe/joeyos-merged

9B • Updated Mar 5 • 4

TheMelonGod/Dolphin3.0-Qwen2.5-1.5B-exl3

Updated 11 days ago • 2

TheMelonGod/Dolphin3.0-Qwen2.5-3b-exl3

Text Generation • Updated 5 days ago • 3