You might want to check out open cv library. They have this thing called the haar classifier/training. You train it to recognize an object and then it can look for that object in other images. Here is one example how it was used to recognize sign language. http://sandarenu.blogspot.com/2008/06/opencv-computer-vision...