[pzo]

There are many way how current LLM can be scaled in different dimensions and there are research around it e.g.:

1) Many different AI with different role: business analysis, tester, developer. You as developer are treated as customer and write simple prompt but business analysis AI will make a proper step by step prompt to Developer AI - so that you don't have to very good with prompt engineering

2) bigger context for LLM so you can feed up to date documentation and full repo

3) LLM having access to do RAG on web search to get up to date information

4) LLM having access to terminal and debugger so Tester/Developer AI can automatically see the flow how code is executed and variables states during execution

5) faster and cheaper LLM so that you give a task before you go to sleep and all those AI in a loop try to solve this task trying many different options until passed all tests.

[yNeolh]

Yes, but that doesn't change how they fundamentally work. You can replicate things fast, with many variations, almost like brute force but more "thoughtful." Don't get me wrong, this opens many possibilities, and I am even thinking about having a local AI machine for my stuff. However, working with multiple layers of knowledge connections is where I don't see LLMs arriving. Maybe some other technology is based on this, but following LLM evolution will be better data and "patches".