Hacker News new | ask | show | jobs
by betimsl 475 days ago
Running a 7b coder in laptops with 4060 is possible and with very good results. Orra looks like a very good tool to be integrated with any IDE. Take a look at this: https://github.com/huggingface/llm.nvim -- it has a backend option. Ollama exposes a REST API, I think you guys should support it :)
1 comments

Thanks! Will take a look.