I've used both, and I found that Pentadactyl was MUCH faster. In addition, it handles passthrough keys more sensibly. Vimperator required a plugin, pentadactyl uses the passkeys setting.
My pentadactylrc: https://github.com/bingaman/dotfiles/blob/master/pentadactyl...