[infruset]

I have the same question, and more generally: Any generic way of doing this for any of the open source or semi open source models, especially Mistral[0]?

[0] https://news.ycombinator.com/item?id=37675496