I think it's more infamous because the clip has been used memetically as a joke on other people/things freaking out about stuff. So the movie's not infamous but the clip is.
But it's still just famous because it's used in a humorous context. When I think of all of the combinations of those clips I've seen, I think of them in a funny way, not a bad way.
Maybe those clips are really offensive to some people, in which case they would be infamous to the offended.
Maybe those clips are really offensive to some people, in which case they would be infamous to the offended.