[NickPollard]

There have already been Playstation Move demos that do exactly this, with superb accuracy and great response times.

(Disclaimer: I work for SCEE, but this is my own opinion)