[extheat]

I'm personally looking forward to it. One of the biggest advantages with running locally is cost. Yes, the upfront cost to getting your own hardware is much higher, but I'd much rather pay for something once then worry about paying a monthly bill for using someone else's infra that they may at any time decide to pull out of service or hike the price for.

The "no data sent to servers" point I agree is super important for work things. I pay for and use Github Copilot for personal things but I'm not allowed to use it at work for obvious reasons. If we could remove the privacy concerns and run these models on local hardware (that people actually have) then it'd be game changing.

Reading some of the other anti-AI comments is a bit odd. I guess it's going to depend on what you do for work, but as someone who writes software not using Copilot is like comparing myself from a 0.25x developer to a 2x developer. I mean that when I say it, but I get that you do need to be able to identify wrong code faster than you can run it.