Hacker News new | ask | show | jobs
by immannino 2999 days ago
So I’ve actually been trying to brainstorm this for awhile. It’s really tough because I can’t programmatically validate the videos. Right now I was thinking of some kind of caching to keep a fire base of the correct music videos, and then having a pop up for the user to give feedback on whether or not the video I displayed for them is a music video or just music+album cover, and then have them be able to link the correct music video or submit a ticket and I could manually update that video in a database. Not 100% sure yet but I’m working on it
1 comments

I had a similar problem previously and considered automating it by comparing frames. It's not easy and would have obvious false positives/negatives, but YouTube does help by publishing key frames and it could at least be used to help rank results.

Take this example music video:

https://www.youtube.com/watch?v=6vopR3ys8Kw

Frames:

https://img.youtube.com/vi/6vopR3ys8Kw/0.jpg

https://img.youtube.com/vi/6vopR3ys8Kw/1.jpg

https://img.youtube.com/vi/6vopR3ys8Kw/2.jpg

https://img.youtube.com/vi/6vopR3ys8Kw/3.jpg

And this lyrics video version (more interesting because it's SOMEWHAT changing):

https://www.youtube.com/watch?v=FoAqHxm5dpo

Frames:

https://img.youtube.com/vi/FoAqHxm5dpo/0.jpg

https://img.youtube.com/vi/FoAqHxm5dpo/1.jpg

https://img.youtube.com/vi/FoAqHxm5dpo/2.jpg

https://img.youtube.com/vi/FoAqHxm5dpo/3.jpg

Simply finding the differences between frames would give the first video a higher score than the second.

I commented on your parent post before reading this...

Nice catch on the thumbnails that YouTube already captures. A histogram comparison between the second and third auto-generated thumbnails from the lyrics video was mostly equivalent when I ran one. That would be a good sign that it's not the actual music video.