[sebzim4500]

Yes, but to my knowledge it doesn't do any of the complicated optimization stuff that SOTA quantisation methods use. It basically is just doing a bunch of rounding.

There are advantages to simplicity, after all.

[brucethemoose2]

Its not so simple anymore, see https://github.com/ggerganov/llama.cpp/pull/1684