[dankle]

What's the reason to not integrate with llama.cpp instead of a separate app? In what ways this better than llama.cpp?

[austinvhuang]

On uses, see https://news.ycombinator.com/item?id=39481554#39482302 and on llama.cpp support - https://news.ycombinator.com/item?id=39481554

Gemma support has been added to llama.cpp, and we're more than happy to see people use it there.

[freedomben]

I think on uses you meant to link to https://news.ycombinator.com/item?id=39482581 child of https://news.ycombinator.com/item?id=39481554#39482302 ?

side note: imagine how gnarly those urls would be if HN used UUIDs instead of integers for IDs :-D