[Nicole9]

Cool. Another AI project written in Rust! The local model has been a great idea for privacy and compliance! Which local models do you think can support this kind of agent? I suppose you need at least a 140B model to work well?

[rctstudio2018]

Yes, you'd need some kind of edge computing to actually cowork with for this architecture. For now, I would recommend stick with some Tier 1 models like Claude sonnet 4.5, GPT 5.2, etc.

But I highly believe open source models will catch up soon and there are lots of potentials there comparing to closed cloud models.