Hacker News new | ask | show | jobs
by mmcwilliams 154 days ago
The moat is building GPU infrastructure to serve inference at scale.
1 comments

Not just building GPU infrastructure to serve inference at scale, but also constraining GPU infrastructure and pricing it out of reach for individuals who wish to pursue open models.

I'm not sure what entirely to do about it, but the fact that some providers still release open models is hopeful to me.