Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

12,558

Base only

Active filters: dpo

syntropy-ai/Soren-1-Small

Text Generation • 2B • Updated 8 days ago • 1.81k • 27

sweepai/sweep-next-edit-v2-7B

Text Generation • 8B • Updated 25 days ago • 753 • • 32

F16/z-image-turbo-flow-dpo

Feature Extraction • Updated Apr 9 • 186

XiangJinYu/Qwen3.5-9B-Humanize-DPO-Round2

Text Generation • Updated 25 days ago • 106 • 4

IHP-Lab/Qwen2-Audio_PCLM_DPO

Audio-Text-to-Text • 8B • Updated 5 days ago • 18 • 2

mlabonne/NeuralHermes-2.5-Mistral-7B

Text Generation • 7B • Updated Apr 8, 2024 • 99 • • 154

mlabonne/NeuralDaredevil-8B-abliterated

Text Generation • 8B • Updated Jan 23 • 15.1k • • 271

sapienzanlp/Minerva-7B-instruct-v1.0

Text Generation • Updated Dec 5, 2024 • 2.85k • 23

codelion/Qwen3-0.6B-PTS-DPO

Text Generation • 0.6B • Updated May 12, 2025 • 34 • 2

openmed-community/AFM-4.5B-OpenMed-GGUF

Text Generation • 5B • Updated Oct 2, 2025 • 54 • 9

RISys-Lab/RedSage-Qwen3-8B-DPO

Text Generation • 8B • Updated Feb 9 • 1.05k • • 8

aquiffoo/neo-3-1B-A90M-Instruct

Text Generation • Updated Apr 17 • 4

mrshu/qwen35-0.8b-dpo-think

Text Generation • 0.8B • Updated Mar 13 • 10 • 1

qualcomm-ai-hub-community/CyberSpark2-3b-cabin-chat

Image-Text-to-Text • 4B • Updated 5 days ago • 35 • 2

tensorfiend/DotLM-165M

Text Generation • 0.2B • Updated Apr 4 • 2 • 1

BugTraceAI/BugTraceAI-Apex-G4-26B-Q4

25B • Updated 28 days ago • 835 • 59

XiaoXu123123/academic-humanize-qwen25-7b-dpo-v2-lora

Text Generation • Updated 28 days ago • 69 • 2

OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated

Image-Text-to-Text • 123B • Updated 15 days ago • 996 • 8

EvanOLeary/laguna-xs2-dense-k8-cuda-dpo

Text Generation • 3B • Updated 9 days ago • 43 • 1

IHP-Lab/AF3_PCLM_DPO

Audio-Text-to-Text • Updated 5 days ago • 16 • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 9 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 15 • 19

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 3

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 23 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 13 • 9

argilla/notus-7b-v1-lora

Text Generation • Updated Dec 4, 2023 • 19 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

argilla/notus-7b-v1

Text Generation • 7B • Updated Dec 5, 2023 • 74 • 124

ContextualAI/archangel_sft_pythia1-4b

Text Generation • 1B • Updated Jan 11, 2024 • 3