[bonoboTP]

A lot of knowledge in such niches has never been written down. Papers don't contain it. Tacit knowledge, it's in unpublished config files and unpublished experiments that some prof or PhD student remembers, all the things that are not "publishing-worthy" (because not flashy, not novel-sounding enough, or a negative result etc) but crucial for the method to actually work. Most of expertise is like this and this is why spending years in a research group, talking to the researchers, participating in their culture, understanding their thinking over years (or even just months) can be invaluable. There are also many things that people only say after a beer, after you know each other well. Claude and ChatGPT haven't ingested any of this. They ingested the sanitized surface version, the press release / advertisement version. Because papers are basically career marketing and advertisement mostly. The real expertise is guarded and hidden.

This is of course about the PhD level and beyond. For regular university-level education, where the goal is to pass the usual exams, ChatGPT and Claude are more than enough. But for real-world "doing", not (yet).