[mrbukkake]

You're right, I forgot that markov chains are memoryless

[dminor]

I used a letter by letter Markov chain for this: http://password.supply/

The output is definitely not convincing as actual words (but reasonable for somewhat more memorable passwords).