It would be great if you can make it generic, to use any model not just Mistral. Take a look at LiteLLM.
It would be great if you can make it generic, to use any model not just Mistral. Take a look at LiteLLM.