You can probably get some improved performance using hidden markov models to place of the voting scheme.