Hacker News new | ask | show | jobs
by tomr75 381 days ago
presumably their apply model is run on their servers

I wonder how hard it would be to build a local apply model/surely that would be faster on a macbook
2 comments
bhaktatejas922 378 days ago
Its hard to get a model that does it usefully on your laptop. Theres an open source 1.5B model from QuocDat, and Morph - https://morphllm.com which is a fast apply model as an API (that I run)
link
notpushkin 380 days ago
It’s possible, but they allow you to specify your own API (that’s how they got the prompts in this article).
link