[twosdai]

You could consider making your hobby project to get a local AI stack up and working.

Open source models are not as good as claude, or GPT. But they don't need to be to fulfill useful small tasks. I think its worth considering using claude from your work to help you setup a local harness and model and then use that.

To me it feels a bit more fulfilling.

[0x70run]

I would love this tbh, but it's just that context window issue for me right now. For my personal use, I have a MacBook Air M5 (maxed out), but I don't think I can run anything decent with large context window (for longer chat sessions) on it. I should also mention that I'm still learning about LLMs, so if I've missed something please do let me know. Running local LLMs is something I'm very interested in.