Nick Brooks

nickandbro's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in nm-testing/pixtral-12b-w4a16-actorder-group over 1 year ago

What is an actorder group and what are the advantages of running this in vLLM?

4

#1 opened over 1 year ago by

nickandbro

New activity in RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic over 1 year ago

Can you please add Nemotron 70B static?

3

#1 opened over 1 year ago by

nickandbro

New activity in nvidia/Llama-3_1-Nemotron-51B-Instruct over 1 year ago

vLLM compatible?

👍 5

3

#10 opened over 1 year ago by

nickandbro

New activity in RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8 almost 2 years ago

Is this compatible with the KV_Cache_dtype being FP8?

2

#1 opened almost 2 years ago by

nickandbro

New activity in jbilcke-hf/ai-comic-factory almost 2 years ago

Where can I find the code?

3

#832 opened almost 2 years ago by

nickandbro