|
|
|
|
|
|
by mcguire
1816 days ago
|
|
|
"I really hate when people describe an ai as something that cannot be understood because they personally don't understand it." On the other hand, keep in mind that a significant weakness of most modern AI research is that it's extremely difficult to understand: you have the input, the output, and a bag of statistical weights. In the story, you know the (trivially bad) function that is being optimized; in general you may not. It's not without implications for other systems. Further, "At the end of the day, student and teacher concluded two things: "* The initial bizarre wolf behavior was simply the result of ‘absolute and unfeeling rationality’ exhibited by AI systems. "* It’s hard to predict what conditions matter and what doesn’t to a neural network." |
|
|
> The initial bizarre wolf behavior was simply the result of ‘absolute and unfeeling rationality’ exhibited by AI systems.
This is a bad quote. They should not say this. It's a poorly trained agent doing a decent job of a poorly defined environment. Absolute rationality conjures images of some greater thinking but its actually a really stupid model that hit a local maxima. Calling it unfeeling implies the model has some concept of "wolf" and "suicide" but it does not. Replace the visuals with single pixel dots if you want an honest depiction of the room for feelings.
> It’s hard to predict what conditions matter and what doesn’t to a neural network."
This is generally true, but it isn't true here.