FP8 LLMs for vLLM
Collection
Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 42 items • Updated • 79
Krystof Olik
ArmykOliva
AI & ML interests
None yet
Recent Activity
liked a model about 17 hours ago
google/medgemma-27b-text-it liked a model about 17 hours ago
google/gemma-3-27b-it liked a Space 1 day ago
google/appoint-readyOrganizations
upvoted a collection about 1 year ago