Hacker News new | ask | show | jobs
by spacemanspiff01 687 days ago
I hope the glut will spur a bunch of research that is currently not possible outside large labs.
2 comments

Glut still costs $$$$ to run, electricity isn't cheap at that scale.
It's a different order of magnitude, though. Buying an H200 GPU costs upward of $30,000. The electricity cost to run it at full power for a year would only cost me $675 (700 watt TDP, 11 cents per kilowatt hour at my house.)
Everyone having their own private multimodal assistant on the cheap will be pretty futuristic if we can make it happen