Once the industry has to acknowledge a plateau, there’ll be a pivot to “human in the loop” products. But instead of discussing their inability to do full automation, they’ll play up the ethics of preserving jobs for humans
I'm not sure if plateauing is the right interpretation of what is happening right now. The arrival of LLMS was like the doors opening on some massive Black Friday sale, you see news footage of people rushing in in a wave scrambling to find the best goodies and some crazed mother jumping up and down with a HotChix Viking Warrior edition like it's the holy grail. It is attention grabbing but not the real benefit of having doors that open.
I'll step out of the metaphor now before it gets stretched too far, but the point is tranformers and LLMs were a real advancement. From reading papers, it seems like things are still advancing at a steady pace. The things that advance at a steady pace are just not the things that grab the headlines. Frequently the things that do grab the headlines do not contribute to to the overall advancement.
To use another metaphor. The crashing waves reach you because the tide is coming in, you notice the waves first, but the waves are not the tide. The wave receding does not mean the tide is going out.
Once the industry has to acknowledge a plateau, there’ll be a pivot to “human in the loop” products. But instead of discussing their inability to do full automation, they’ll play up the ethics of preserving jobs for humans