[segmondy]

Just a matter of time. Go download gpt2 or llama2 and be shocked at how bad they are compared to today. They were entirely "useless" yet we marveled at them. Go examine GPT3.5/gpt4 out which was all the rage and then marvel at how a qwen27b or gemma31b model mops the floor today. My point is that the models will eventually learn to have a great model of software system in their head, just a matter of time and proper RL.

[sph]

There is no Moore’s law for AI that shows that the previous rate of improvement will likely apply to the future. It’s all wishful thinking.

[ozim]

There is bunch of rich and powerful assholes trying to protect their investments.

I am pretty sure rate of improvement will be there quite long in the future — even if it will be smoke and mirrors ;)