Hacker News new | ask | show | jobs
by tomw1808 491 days ago
Is the idea here to basically transform the almost unlimited degrees of freedom an AI has in manipulating rastered image properties from one frame to another in a limited set of known things it can change?

I mean, unless its a wild magic sci-fi movie, it makes sense that once a character is known in separation to its background, that the background doesn't change with a hands movement of the character. And the character cannot move beyond earthy physics?

Is that what this is?

1 comments

Yeah, that’s pretty much the idea. AI has a lot of freedom when generating each frame independently, which often leads to inconsistencies. By using a 3D base, we’re constraining that freedom. Locking in composition, lighting, and perspective so AI doesn’t hallucinate unintended changes. The goal is to have a stable structure where AI can still add detail and style but without breaking spatial or physical consistency.