[brucethemoose2]

I am running linux with cublast offload, and I am using the new 3 bit quant that was just pulled in a day or two ago.

[smiley1437]

Thanks! I'll have to try the 3bit to see if that helps

[LoganDark]

cuBLAS or CLBlast? There is no such thing as cublast