[keernan]

>... trying to understand how the billions of weights in ChatGPT interact with each other.

Isn't that just a computational problem? In theory, couldn't every expression and result be debug.print and followed? Indeed, in theory couldn't a second chatGPT process follow the debug.print process of the first chatGPT process and then explain to humans how the result of the first process was derived?