NVFP4 for 16GB of VRAM 5070ti?
#3
by hugless - opened
Hi All.
is this model constructed in a way that must be loaded in vram all at once? meaning it wont work in my kit? thanks
do you mean like is it tansformer/vae/text projection in one? yes.
but there is a lot of tools to offset things, all depends on what your "kit" is, a lot of people are running ltx2.3 in 16 and even 12gb vram, even heard of a few pushing 8gb, but, yeah, that's gotta be slow.
Probably necro-threading, but the FP8 model is higher quality compared to the NVFP4 model. There is noticeable pixelation in the NVFP4 model.
rluxemburg changed discussion status to closed