[yassa9]

what quantization did u try ? u can use Q4 quantization, im pretty sure that 48GB would be enough

[sgt101]

8bits is fine.... I was talking full bore.