[ben_w]

My point here is that regardless of how you view the entire system of [human + room + books], the human themselves in that system are still just a cog. The human themselves doesn't know Chinese, they are literally writing down Chinese without understanding it, by design of the thought experiment.

"Is the Chinese Room intelligent/conscious?" is a scissor question*, i.e. people strongly disagree about what it shows.

Myself, I'm with you: the system collectively is intelligent, despite the human in the loop being reduced to a cog in that system. The biological analogy to "the human does not understand Chinese therefore the system is not conscious" would be "no individual cell in a human body knows what the human is doing therefore humans are not conscious".

* https://www.lesswrong.com/w/scissors-statements