[Luker88]

Nice!

Do they have plans to bring even bigger models down to ~16GB VRAM so that more consumer hardware might be useful?

[verdverm]

bigger quant'd harder is not always better than a model of more modest size and quant