[xrd]

Really appreciate your response.

I'm trying to recreate my experiences with claymation when I was a kid. I want to take a picture of an object, like a lego figure, and then move it slightly, take another picture, then move the figure again slightly. Once I have some frames, I want to use a NERFs to interpolate between those frames.

When I was young and doing claymation, I would move the figure, shoot two frames, and do that 12 times per second of film. And, the lights I used were often so hot, that my clay would melt and alter the figure. It was a chore.

I thought I could capture fewer in-between frames and let the NERF figure out the interpolation, and perhaps get some weird side effects. Especially if it hallucinates.

I'm not sure if a NERF is the right approach, but it seems like a good starting point.

Thank you.

[turkihaithem]

You might also want to take a look at diffusion models: https://vidim-interpolation.github.io/

In terms of publicly available code, I think Stable Video Diffusion can do frame interpolation (https://stability.ai/news/introducing-stable-video-diffusion...), but I haven't tried it myself.

[xrd]

That stuff is perfect. Thanks. I will definitely play with this.