What about Watson? How did it generate language? My understanding is it output language well enough to match what LLMs do today.
According to someone who worked on it, it would fail a second grade level reading exam: https://www.nytimes.com/2021/07/16/technology/what-happened-...
According to someone who worked on it, it would fail a second grade level reading exam: https://www.nytimes.com/2021/07/16/technology/what-happened-...