Inference Providers
Active filters: dpo
syntropy-ai/Soren-1-Small
Text Generation
• 2B • Updated • 1.81k
• 27
sweepai/sweep-next-edit-v2-7B
Text Generation
• 8B • Updated • 753
• • 32
F16/z-image-turbo-flow-dpo
Feature Extraction
• Updated • 186
XiangJinYu/Qwen3.5-9B-Humanize-DPO-Round2
Text Generation
• Updated • 106
• 4
IHP-Lab/Qwen2-Audio_PCLM_DPO
Audio-Text-to-Text
• 8B • Updated • 18
• 2
mlabonne/NeuralHermes-2.5-Mistral-7B
Text Generation
• 7B • Updated • 99
• • 154
mlabonne/NeuralDaredevil-8B-abliterated
Text Generation
• 8B • Updated • 15.1k
• • 271
sapienzanlp/Minerva-7B-instruct-v1.0
Text Generation
• Updated • 2.85k
• 23
codelion/Qwen3-0.6B-PTS-DPO
Text Generation
• 0.6B • Updated • 34
• 2
openmed-community/AFM-4.5B-OpenMed-GGUF
Text Generation
• 5B • Updated • 54
• 9
RISys-Lab/RedSage-Qwen3-8B-DPO
Text Generation
• 8B • Updated • 1.05k
• • 8
aquiffoo/neo-3-1B-A90M-Instruct
Text Generation
• Updated • 4
mrshu/qwen35-0.8b-dpo-think
Text Generation
• 0.8B • Updated • 10
• 1
qualcomm-ai-hub-community/CyberSpark2-3b-cabin-chat
Image-Text-to-Text
• 4B • Updated • 35
• 2
Text Generation
• 0.2B • Updated • 2
• 1
BugTraceAI/BugTraceAI-Apex-G4-26B-Q4
25B • Updated • 835
• 59
XiaoXu123123/academic-humanize-qwen25-7b-dpo-v2-lora
Text Generation
• Updated • 69
• 2
OpenYourMind/Qwopus3.5-122B-A10B-Kimi-K2.6-destill-healed-abliterated
Image-Text-to-Text
• 123B • Updated • 996
• 8
EvanOLeary/laguna-xs2-dense-k8-cuda-dpo
Text Generation
• 3B • Updated • 43
• 1
Audio-Text-to-Text
• Updated • 16
• 1
lyogavin/Anima33B-DPO-Belle-1k
Text Generation
• Updated • 1
lyogavin/Anima33B-DPO-Belle-1k-merged
Text Generation
• Updated • 9
• 12
daekeun-ml/Llama-2-ko-DPO-13B
Text Generation
• 13B • Updated • 15
• 19
lewtun/zephyr-7b-dpo-full
Text Generation
• 7B • Updated • 3
alignment-handbook/zephyr-7b-dpo-full
Text Generation
• 7B • Updated • 23
• 3
alignment-handbook/zephyr-7b-dpo-qlora
Updated • 13
• 9
Text Generation
• Updated • 19
• 7
argilla/notus-7b-v1-lora-adapter
Text Generation
• Updated • 3
Text Generation
• 7B • Updated • 74
• 124
ContextualAI/archangel_sft_pythia1-4b
Text Generation
• 1B • Updated • 3