[gleenn]

AI had a winter of many decades because the hardware wasn't there and there were better alternatives, especially for neural nets. Now ChatGPT etc comes out, with unbelievable results, decades in the making. And a couple months we're already writing it off because of the next limitation? Maybe let's give it more than a month or two to figure out if we even need all that data. I heard they're already talking about trying to significantly reduce the model hyper parameters size even though a large model size increase apparently the reason GPT 4 was so much better than 3. Give it a minute IMHO before making generalizations like this so soon

[mjburgess]

Well I imagine the commenter actually understands the domain, the techniques, and is making an informed opinion.

It is possible to form opinions by knowing the domain, rather than drawing an exponential curve of newspaper headlines which trails off "..."