[theaiquestion]

You might consider supporting ooba's api which would give you a lot of support for different things really quickly.

https://github.com/oobabooga/text-generation-webui/

[nullsense]

Yeah, I second this. I use this frequently and lots of models downloaded that I test out with it. I'm keen to see a more API led approach.