[ekianjo]

This would require massively more compute than regular pipelines...

[plaidfuji]

(1) that delta will decrease quickly, and (2) corporations will gladly pay for compute over headcount to maintain fragile data pipelines

[timr]

> (1) that delta will decrease quickly

Is your data pipeline o(n^3) in the number of tokens? If not, then no, it won't.

[ekianjo]

The price will go down, but LLMs reaching 100% accuracy and reliability is another story. We are nowhere close right now.

[galgia]

If your problem is compute, you are already optimizing. This is here for all the steps before you start thinking latency-compute. Not all use cases are made equal.