Music tech has been wrestling with novel controllers including several like the kind you speak of for a while now: http://www.nime.org. Take a look through some of those conference notes for ideas. This is from 2003: http://nime.org/2003/nime03_program.html