Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.
AI & ML interests
Decentralized GenAI Agents network on the Edge
Gaia compatible quants for Llama 3.1, 3.2 and 3.3 Instruct models.
-
gaianet/Llama-3.2-1B-Instruct-GGUF
Text Generation β’ 1B β’ Updated β’ 264 -
gaianet/Llama-3.2-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 285 β’ 1 -
gaianet/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation β’ 8B β’ Updated β’ 417 -
gaianet/Llama-3.3-70B-Instruct-GGUF
Text Generation β’ 71B β’ Updated β’ 240
-
gaianet/Mistral-Small-24B-Instruct-2501-GGUF
Text Generation β’ 24B β’ Updated β’ 53 -
gaianet/Mistral-7B-Instruct-v0.3-GGUF
Text Generation β’ 7B β’ Updated β’ 166 β’ 1 -
gaianet/Mistral-Nemo-Instruct-2407-GGUF
Text Generation β’ 12B β’ Updated β’ 94 β’ 1 -
gaianet/Mistral-Large-Instruct-2407-GGUF
123B β’ Updated β’ 154
-
gaianet/DeepSeek-R1-Distill-Llama-70B-GGUF
Text Generation β’ 71B β’ Updated β’ 231 β’ 1 -
gaianet/DeepSeek-R1-Distill-Qwen-32B-GGUF
Text Generation β’ 33B β’ Updated β’ 65 -
gaianet/DeepSeek-R1-Distill-Llama-8B-GGUF
Text Generation β’ 8B β’ Updated β’ 123 β’ 1 -
gaianet/DeepSeek-R1-Distill-Qwen-7B-GGUF
Text Generation β’ 8B β’ Updated β’ 152
Gaia compatible quants for InternLM-2.5 models.
-
gaianet/gemma-3-27b-it-GGUF
Image-Text-to-Text β’ 27B β’ Updated β’ 251 β’ 1 -
gaianet/gemma-3-12b-it-GGUF
Image-Text-to-Text β’ 12B β’ Updated β’ 247 β’ 1 -
gaianet/gemma-3-4b-it-GGUF
Image-Text-to-Text β’ 4B β’ Updated β’ 194 β’ 1 -
gaianet/gemma-3-1b-it-GGUF
Text Generation β’ 1.0B β’ Updated β’ 284 β’ 1
Gaia compatible quants for Qwen 2.5 instruct and coder models.
-
gaianet/Qwen2.5-72B-Instruct-GGUF
Text Generation β’ 73B β’ Updated β’ 141 β’ 1 -
gaianet/Qwen2.5-14B-Instruct-GGUF
Text Generation β’ 15B β’ Updated β’ 159 -
gaianet/Qwen2.5-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 463 β’ 1 -
gaianet/Qwen2.5-32B-Instruct-GGUF
Text Generation β’ 33B β’ Updated β’ 169
Gaia compatible quants for Qwen2.5-Coder models.
-
gaianet/Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation β’ 33B β’ Updated β’ 128 -
gaianet/Qwen2.5-Coder-14B-Instruct-GGUF
Text Generation β’ 15B β’ Updated β’ 229 -
gaianet/Qwen2.5-Coder-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 265 β’ 2 -
gaianet/Qwen2.5-Coder-0.5B-Instruct-GGUF
Text Generation β’ 0.5B β’ Updated β’ 168
Gaia compatible quants for functionary models
Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.
-
gaianet/gemma-3-27b-it-GGUF
Image-Text-to-Text β’ 27B β’ Updated β’ 251 β’ 1 -
gaianet/gemma-3-12b-it-GGUF
Image-Text-to-Text β’ 12B β’ Updated β’ 247 β’ 1 -
gaianet/gemma-3-4b-it-GGUF
Image-Text-to-Text β’ 4B β’ Updated β’ 194 β’ 1 -
gaianet/gemma-3-1b-it-GGUF
Text Generation β’ 1.0B β’ Updated β’ 284 β’ 1
Gaia compatible quants for Llama 3.1, 3.2 and 3.3 Instruct models.
-
gaianet/Llama-3.2-1B-Instruct-GGUF
Text Generation β’ 1B β’ Updated β’ 264 -
gaianet/Llama-3.2-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 285 β’ 1 -
gaianet/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation β’ 8B β’ Updated β’ 417 -
gaianet/Llama-3.3-70B-Instruct-GGUF
Text Generation β’ 71B β’ Updated β’ 240
Gaia compatible quants for Qwen 2.5 instruct and coder models.
-
gaianet/Qwen2.5-72B-Instruct-GGUF
Text Generation β’ 73B β’ Updated β’ 141 β’ 1 -
gaianet/Qwen2.5-14B-Instruct-GGUF
Text Generation β’ 15B β’ Updated β’ 159 -
gaianet/Qwen2.5-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 463 β’ 1 -
gaianet/Qwen2.5-32B-Instruct-GGUF
Text Generation β’ 33B β’ Updated β’ 169
-
gaianet/Mistral-Small-24B-Instruct-2501-GGUF
Text Generation β’ 24B β’ Updated β’ 53 -
gaianet/Mistral-7B-Instruct-v0.3-GGUF
Text Generation β’ 7B β’ Updated β’ 166 β’ 1 -
gaianet/Mistral-Nemo-Instruct-2407-GGUF
Text Generation β’ 12B β’ Updated β’ 94 β’ 1 -
gaianet/Mistral-Large-Instruct-2407-GGUF
123B β’ Updated β’ 154
Gaia compatible quants for Qwen2.5-Coder models.
-
gaianet/Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation β’ 33B β’ Updated β’ 128 -
gaianet/Qwen2.5-Coder-14B-Instruct-GGUF
Text Generation β’ 15B β’ Updated β’ 229 -
gaianet/Qwen2.5-Coder-3B-Instruct-GGUF
Text Generation β’ 3B β’ Updated β’ 265 β’ 2 -
gaianet/Qwen2.5-Coder-0.5B-Instruct-GGUF
Text Generation β’ 0.5B β’ Updated β’ 168
-
gaianet/DeepSeek-R1-Distill-Llama-70B-GGUF
Text Generation β’ 71B β’ Updated β’ 231 β’ 1 -
gaianet/DeepSeek-R1-Distill-Qwen-32B-GGUF
Text Generation β’ 33B β’ Updated β’ 65 -
gaianet/DeepSeek-R1-Distill-Llama-8B-GGUF
Text Generation β’ 8B β’ Updated β’ 123 β’ 1 -
gaianet/DeepSeek-R1-Distill-Qwen-7B-GGUF
Text Generation β’ 8B β’ Updated β’ 152
Gaia compatible quants for functionary models
Gaia compatible quants for InternLM-2.5 models.