Question about 4 bit GGML
#1
by
srwill - opened
Hello! I apologize in advance, do not consider the request for impudence, but could you upload a quantized model in 4-bit in GGML format?
Thanks to Melbourne, which converted this interesting model to ggml, the issue is resolved.
srwill changed discussion status to
closed