My point being that these generation models should be conditioned on something more than just word history, like something they want/are instructed to express.