[pohl]

That has always been my impression, despite the myriad ways that LLMs impress.

So much potential is lost just in the request/response limitation. While I’m waiting for a response from GPT-4, I’m continuing to think. Imagine if the reverse were true. AGI needs to be able to mull things over for spans of time.

[pixl97]

At least any company trying to sell a product this is going to be an issue with operations costs.

Also this gets into the halting problem. How many resources do you expend on finding an answer? In a human issues will typically come up like we have to go pee, or eat, or something outside our body interrupts us. For an AI, how much time should it spend? Do we want to wake up one day finding our data centers running at full tilt?

This said, there have been some attempts at working on agent based systems that reach out for answers from multiple places and pool the data then run things like chain of thought on that data pool.