|
|
|
|
|
by xotesos
809 days ago
|
|
Totally agree. What is hard to see right now in business is talked about by Charlie Munger in Poor Charlie's Almanac. What you describe will save your company money because you are an early adopter but in the long run, everyone is going to do these kind of things and the savings will be passed on to the consumer. Munger mentions this talking about a textile business they had. The new more efficient machine wasn't going to make the business better but just end up passing savings on to the consumer so they actually sold the business. Management wouldn't have prioritized that project for engineering because it would have cost too much and have uncertain benefits given the cost. This is all massively deflationary and certain highly prized skills that cost $120k a year per right now, will be $20 bucks a month in 2024 dollars someday. |
|
I've said this many times but the only thing stopping me from using GPT4 API for everything in my life is inference cost - both context window limitations and cost per token. I would try to feed everything into GPT4 if I could.
Inference will be solved one day.
The cost to serve a website today is probably millions of times cheaper than in 1998. Heck, Cloudflare literally gives you unlimited bandwidth for your website for free. It's that cheap today.
When inference cost is much higher today and the cost to do inference is as cheap as loading a website today, I think the world will be profoundly different.