openai/gsm8k
Benchmark • Updated • 17.6k • 1.16M • 1.8k
How to use nomadicsynth/Qwen2.5-3B-Instruct-Reasoning-gsm8k-lora-v1 with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("unsloth/qwen2.5-3b-instruct-unsloth-bnb-4bit")
model = PeftModel.from_pretrained(base_model, "nomadicsynth/Qwen2.5-3B-Instruct-Reasoning-gsm8k-lora-v1")This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.
Base model
Qwen/Qwen2.5-3B