I was bothered by using Vim with Dvorak but now I find it more comfortable than when I did not use Vim daily. The solution described in article may be useful for using Vim with other language and still have a command mode.
I think I would also get used to using colemak after a while, but I wanted hjkl to be on hjkl and if I remapped one thing then I lost some other key, thus I decided to go all out and just remap everything.