[mathematicaster]

Is there any indication from OpenAI people that there are low hanging fruits to be picked in this direction?

[summarity]

It’s the indication data of current research: train more and better, current models are oversized and undertrained. A good foundation model can exhibit massive quality differences with just a tiny bit of quality fine tuning (e.g. Alpaca vs Koala)

Personal opinion, not OAI/GH/MSFT’s