Hugging Face's logo

AlphaOxO
/
GPT4All-J-MXFP4-mlx

Text Generation
MLX
Safetensors
English
gptj
4-bit precision
Model card Files
xet
 Community

GPT4All-J-MXFP4-mlx

Introduce

Quant by mlx-lm 0.31.3 with new pipeline for GPT-J model_type

ref

Usage 

mlx_lm.generate mlx_lm.generate --model /path/to/model --prompt "What is different between CPU and GPU?" --max-tokens 2048
Downloads last month
141
Safetensors
Model size
1B params
Tensor type
F32
·
U8
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for AlphaOxO/GPT4All-J-MXFP4-mlx

Base model

nomic-ai/gpt4all-j
Quantized
(1)
this model

Collection including AlphaOxO/GPT4All-J-MXFP4-mlx