[robrenaud]

That just sounds like a poorly tuned algorithm/learning rate in the single threaded case. Certainly you can emulate the parallel algorithm sequentially if you wanted.

[utopcell]

True, you could definitely emulate it by shuffling the input, but that's not what is being done unfortunately.