[BinaryIdiot]

This detects a face and displays the attributes it calculated about it. That's pretty interesting though from the title I thought it was something that looked up people and displayed their name, etc.

Pretty cool though ultimately it just takes the Halo Lens input, sends it to the Microsoft Face API[1] and displays its results.

[1] https://www.microsoft.com/cognitive-services/en-us/face-api

[wwwigham]

It does try to identify names, actually. Looking at the source[1], once it has used the Oxford API to find where faces are in the frame (and their approx age and gender, etc), each individual face is then also queried against the MS emotion API and an OpenFace[2] instance. Given the source, it looks like that instance is meant to be trained on staff members and report their organizational hierarchy.

What would be super neat would be ripping out the OpenFace query, and replacing it with a lookup via Facebook[3], so it could actually just show the names for anyone I was FB friends with.

[1]https://github.com/UoA-eResearch/hololens_facial_recognition... [2]https://cmusatyalab.github.io/openface/ [3]https://news.ycombinator.com/item?id=11836884

[adamloving]

Yeah, name and other attribute lookup is feasible (and seems inevitable). Also, this prototype only claims to take a snapshot and submit it. Needs to perform the check in realtime against video input.