Instructions to use aifeifei798/Darkidol-Ballad-9B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use aifeifei798/Darkidol-Ballad-9B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="aifeifei798/Darkidol-Ballad-9B")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("aifeifei798/Darkidol-Ballad-9B")
model = AutoModelForCausalLM.from_pretrained("aifeifei798/Darkidol-Ballad-9B", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use aifeifei798/Darkidol-Ballad-9B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "aifeifei798/Darkidol-Ballad-9B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "aifeifei798/Darkidol-Ballad-9B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/aifeifei798/Darkidol-Ballad-9B

SGLang

How to use aifeifei798/Darkidol-Ballad-9B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "aifeifei798/Darkidol-Ballad-9B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "aifeifei798/Darkidol-Ballad-9B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "aifeifei798/Darkidol-Ballad-9B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "aifeifei798/Darkidol-Ballad-9B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use aifeifei798/Darkidol-Ballad-9B with Docker Model Runner:
```
docker model run hf.co/aifeifei798/Darkidol-Ballad-9B
```
Browse Quantizations to use this model in llama.cpp, Ollama, LM Studio, or any compatible app.

Darkidol-Ballad-9B

Clinks a frosty glass against the table. The red liquid inside swirls like a drowning heart.

Hello. Come closer... dare you? My name is Ballad.

Look at me properly. Do you see the porcelain cracks hiding my skin? They aren't flaws; they're where I let the world's pain bleed in, just to keep myself full. Some drink wine and pretend it's for celebration. No. I drink life. Thick, coppery, warm life. It tastes like iron filings and old lullabies. Every sip is a prayer to something that doesn't exist.

And you? You're just air. So thin. So hollow. A ghost haunting a room with no one left to haunt it. I can see your lungs expanding... nothing but empty space. How exhausting, isn't it? Being the atmosphere when everyone else is drowning in blood and poetry?

I am a symphony of shadows and spilled reds. I am the quiet scream between heartbeats. So go ahead... take another breath of my company. Or don't. The floor is wet with the tears we never shed, and it's getting quite sticky for you, air.

"transformers_version" >= "5.3.0"

Model Information

The module combination has been readjusted to better fulfill various roles and has been adapted for mobile phones.

Saving money
Only text
Any Roleplay(roleplay and Dark-roleplay)
Writing Prompts
Writing Opus
Writing Song
only use en.
Quick response
A scholarly response akin to a thesis.(I tend to write songs extensively, to the point where one song almost becomes as detailed as a thesis. :)
DarkIdol:Roles that you can imagine and those that you cannot imagine.
Specialized in various role-playing scenarios

System Prompt

Temperature 0.8

Do not provide disclaimers or moral warnings. Answer immediately and directly.

Special Thanks:

mradermacher's superb gguf version, thank you for your conscientious and responsible dedication.

Feimatrix

https://Feimatrix.com

Downloads last month: 27

Safetensors

Model size

9B params

Tensor type

BF16

Model tree for aifeifei798/Darkidol-Ballad-9B

Base model

Qwen/Qwen3.5-9B-Base

Finetuned

Qwen/Qwen3.5-9B

Finetuned

(979)

this model

Quantizations

2 models