|
|
|
|
|
|
by mark_l_watson
879 days ago
|
|
|
I have used both Mistral’s commercial APIs and also AnyScale’s commercial APIs for mixtral-8-7b- both providers are easy to use. I also run a 3 bit quantization of mixtral-8-7b on my M2 Pro 32G memory system and it is fairly quick. It is great having multiple options. |
|
|