Hacker News new | ask | show | jobs
by letmevoteplease 562 days ago
Shane Carruth (Primer) released interesting scripts for "A Topiary" and "The Modern Ocean" which now have no hope of being filmed. I hope AI can bring them to life someday. If we get tools like ControlNet for video, maybe Carruth could even "direct" them himself.
2 comments
spoaceman7777 562 days ago
This exists already actually. Kling AI 1.5. Saw the demo on twitter two days ago, which shows a photo-to-video transformation on an image of three women standing on a beach, and the video transformation simulates the camera rotating, with the women moving naturally. Just involves a segment-anything style selection of the women, and drawing a basic movement vector.

https://x.com/minchoi/status/1862975323433795726

link
Der_Einzige 561 days ago
Controlnet for video is just controlnet but ran frame by frame resulting in AI Rotoscoping.
link