[asim]

I don't run local models, my devices are 5-6 years old and not powerful enough. It's a bit counter intuitive and different to what a lot of engineers are doing but I don't have a mac mini, I don't have a powerful laptop, a lot of my dev work has always been cloud based, on github, on a VM, I'm mostly using SSH from my laptop and now Claude Code on my phone (exe.dev is hands down the best experience I had on this front when the agent is literally on the VM).

In an ideal world, yea you can run local models, but I need a powerful always on device for that, or the latest gear, and it will never be as fast as what I can use from google, anthropic, or through an API call. I really wish it was different but I have to shell out a ton of money for that, and I guess it's usecase specific right. Maybe if my phone was super powerful and could run models that would be great, but then I have this issue with cloud sync and using things anywhere else. There will be a world in which local models and self deployed models make sense, this is going to be a core experience, but I personally can't run them.