If your use case is archival (running this on many videos stored on disk) as opposed to realtime (running on a live video feed), we built a research tool called Scanner [1] for maximum performance in offline video analytics, e.g. see our face detection example [2].