Hacker News new | ask | show | jobs
Kalosm 0.3: A Rust framework for local AI (floneum.com)
1 points by Evan-Almloff 661 days ago
1 comments

Kalosm is a library for pre-trained text, audio and visual models in Rust. It includes support for:

- Whisper for audio transcription

- Llama, phi and mistral models for text generation.

- Structured generation: You can generate text that fits your specific format by deriving a parser automatically with structured generation

- Bert for text embedding and search

The latest release adds support for deriving parsers and json schemas to use with structured text generation, real time audio transcription and a bunch of performance improvements