> LLMs are more like apps being produced by different companies trying to capture walled gardens, and their open source counterparts.
I think the analogy to the web is stronger than that.
For now the LLMs are mostly separate, but it won't be long before LLMs emerge that make API calls to other LLMs, sometimes over the internet.
In due course, expect meta-LLMs to emerge that aggregate knowledge from other LLMs by talking to them, rather than by training on their data. Those meta-LLMs which optimise for competitive quality results will have to read the research as it comes out, and continually assess which other new LLMs are worth calling out to, and for which purposes. Eventually the API calls will become bi-directional requests to exchange knowledge and insights, i.e. multiple models talking to each other, continually learning.
LLMs are more like apps being produced by different companies trying to capture walled gardens, and their open source counterparts.