[yencabulator]

As a form of story telling, yes.

As a challenge, not really. You can just convince it to let you win. (Said differently: the meta-game is too easy.)

You need the second layer of output validation[1] to re-add the challenge of solving a puzzle.

[1] or some such mechanism; more rigorous system vs user input separation could also work

[andrewstuart]

True, but remarkably fun stories.

As an aside, there should be an AI encabulator.