[aurareturn]

Yes. I believe so. Maybe it won't happen this year. Maybe not next year. But in 3 years, I think the world will radically change.

Here's an example use case we found for our business:

Our sales people request invoices from a potential customer. On those invoices are our competitor's services and price. We have matching services and our own prices. The goal is to find similar services where we charge less. In the past, our sales people would spend hours combing through those invoices. We wrote a prompt for GPT4, fed in our services and prices, and asked it to find services we could potentially replace as well as our profit margin. It took us a day to write this prompt. The results were outstanding and GPT4 gave accurate results. We even asked it to package it up in a PDF for us.

This will save our company hundreds of thousands each year and we can get back to the potential customer much faster than before - increasing the likelihood of a sale.

If we had to program this like normal software, it'd probably take months to get it right. Chances are, engineering would never even prioritize this feature for our sales people.

GPT6 with much higher context and much cheaper inference cost? Yes please. I think people can't imagine how it's going to change everything.

[xotesos]

Totally agree. What is hard to see right now in business is talked about by Charlie Munger in Poor Charlie's Almanac.

What you describe will save your company money because you are an early adopter but in the long run, everyone is going to do these kind of things and the savings will be passed on to the consumer.

Munger mentions this talking about a textile business they had. The new more efficient machine wasn't going to make the business better but just end up passing savings on to the consumer so they actually sold the business.

Management wouldn't have prioritized that project for engineering because it would have cost too much and have uncertain benefits given the cost.

This is all massively deflationary and certain highly prized skills that cost $120k a year per right now, will be $20 bucks a month in 2024 dollars someday.

[aurareturn]

Agreed. I think many businesses are finding use cases like ours. They're just not on HN disclosing it all.

I've said this many times but the only thing stopping me from using GPT4 API for everything in my life is inference cost - both context window limitations and cost per token. I would try to feed everything into GPT4 if I could.

Inference will be solved one day.

The cost to serve a website today is probably millions of times cheaper than in 1998. Heck, Cloudflare literally gives you unlimited bandwidth for your website for free. It's that cheap today.

When inference cost is much higher today and the cost to do inference is as cheap as loading a website today, I think the world will be profoundly different.