[CyberDildonics]

You want to check out Touch designer. It can do a lot, you including midi, and is made to work in real time.