|
|
|
|
|
by JackHopkins
947 days ago
|
|
Native support for OS LLMs is on the roadmap - the main challenge is to figure out how to manage the knowledge distillation for local models. It’s a top priority (along with typescript support), so check back in a few weeks? Right now any ‘plug-in’ model needs to conform to the OpenAI API. (P.S Carthago delenda est) |
|