|
|
|
|
|
by Kadam257
47 days ago
|
|
The problem isn't that Claude's responses are unimpressive. They are impressive. The problem is that impressive outputs don't tell you anything about underlying mechanism, and mechanism is what consciousness is about. A system optimized via RLHF to produce responses that make smart humans say "wow" will produce responses that make smart humans say "wow". That's what it was trained to do. |
|
In other words, the mechanism may be what consciousness is about, but we can't say anything useful about this as relates to consciousness.