[novok]

I would also start doing image recognition in the video frames, to extract things like gender, objects, etc.

[thekyle]

Would this have any advantage over just using video embeddings (or a sequence of frame embeddings?) which in theory should capture those things in vectorized form.