[AnimalMuppet]

Those that have a realistic acceptance of GPT's limitations.

And that's almost impossible at the moment, because there's so much progress. It's very hard to tell what the actual limitations are. But there will be some. GPT is not AGI.

Companies that think "just get 10 times as much training data, or a little tweak of the model, and those limitations will disappear!" won't last (though they may do really well at getting funding). But companies that think "the current limitations are permanent, so there's no point trying to get it to extend past that" will also not last (unless they adapt fast enough).

Since we don't currently know what the real limits are, it's very hard to give concrete advice here. Maybe "push hard against the limits, but don't bet the company on being able to overcome any particular limit".