Don't you have to try to identify a face first, before you can decide you don't want to identify it? I don't see how it can work if you don't try to identify every face.
You identify that there is a face yes, that's face detection, https://en.wikipedia.org/wiki/Face_detection, which is not the same as face recognition and doesn't need a model per person.