[FeepingCreature]

If logic helps you predict the next word in the text, then a text based model will learn logic.