[dcminter]

Given that you'd already speculated about something similar, sounds like KVMs are the way to go.

You could also take a look at https://symless.com/synergy or something similar (I think there's an open source version too).

I assume you've already considered ssh-ing into them from one "master" machine?