Can you create BF16 quant of the 7b model as well
#1
by
pheonis
- opened
Can you create BF16 quant of the 7b model as well. Thanks
yeah would be nice to have a 7b model . Low vram edition even better.
Can you create BF16 quant of the 7b model as well. Thanks
yeah would be nice to have a 7b model . Low vram edition even better.