Hacker News new | ask | show | jobs
by Snakes3727 38 days ago
Yeah i was looking there earlier, its just we thankfully mostly have macbooks, but i recently found out new devs are getting the smaller 8gb ram macbooks as well. Which is going to be even more frusturating.

Since my team is mostly remote running LLM on a cluster in the office is not really viable short term.
2 comments
baigy 38 days ago
This is totally going to suck, but here's one option I was just suggested a few mins ago: https://www.reddit.com/r/LocalLLaMA/comments/1th1mqx/comment... For context, I was asking about running anything OpenClaw-friendly on my RTX4060 8GB VRAM. I know yours is a more involved use-case, but there's still some optionality here.
link
baigy 36 days ago
Hey man, give this a shot: https://github.com/Doorman11991/smallcode

Harnesses such as this - combined with locally hosted AI models - are the future.

link