openai/gsm8k
Benchmark • Updated • 17.6k • 1.16M • 1.8k
How to use nomadicsynth/Qwen2.5-3B-Reasoning-gsm8k-lora with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-3B")
model = PeftModel.from_pretrained(base_model, "nomadicsynth/Qwen2.5-3B-Reasoning-gsm8k-lora")This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.
Base model
Qwen/Qwen2.5-3B