[winkerVSbecks]

It seems like you literally are describing Processing. I'm not sure if you've heard of it: http://processing.org

It is designed for non programmers – artists and designers, so do a lot of things you are asking for.