[nogajun]

Is this similar to fastllm?

https://github.com/ztxz16/fastllm

[vikmals]

fastllm targets the GPU, while colibri uses CPU inference only

[aliljet]

I'd be curious about an.option that would allow glm use with a low end GPU like a 2080 ti...