[downut]

I have rooftop solar and I have been building credit with my electric utility even though the daily high temperature is well over 100F outside and a comfortable 75F inside. That includes running three AMD 12 thread 128GB systems with obsolete GPUs 24x7x365. I'm not a gamer, so 6 years ago I went low-end low-power GPUs. Boy am I dumb. Currently running the qwen3.6:27b, 35b, and gemma4:31b models just fine.

As soon as VRAM prices drop to sanity I'm going to load up and I could care less about the power draw.

Some parts of the future are absolutely great.

[downut]

I am fascinated that I got down voted. I mean, isn't what I'm doing here nearly ideal? Or maybe not: why? My solar panels shade my roof under the incessant sun of the Sonoran Desert and turn a fraction of the insolation into electrical power that allows me to do almost SOTA local LLM stuff inside my house for free[1] that the parent commenter thought to be economically infeasible. Of course it's slow! So what! Right now I'm transcribing to text a podcast with whisper.cpp and it will take about as much time as the original podcast duration but I will be able to read it in 1/20th of the time.

Alternative interpretation of a downvote: we should all be enslaved to corporate electrical generation provided to "local" electric utility corporations so that we are economically incentivized to use cloud LLM providers. That's weird, no?

Teach me.

[1] It's a small nice house that cost ~$330K not too far off from my city center. This isn't rich privilege boasting.