[schobi]

I would go with something like sift features (or a non patented variant thereof if you plan commercial usage). You analyze a first picture and extract the center part. You run a feature detector on each image and the can cheaply match (scale and rotation invariant) against each other - this gives rotation and scaling.

[phreeza]

Yea that's precisely what I ended up doing, but the frame extraction was quite finicky.