Hacker News new | ask | show | jobs
by autoexec 1388 days ago
AI in animation has been interesting to me for a while now. It leaves me a little conflicted though. If we get to the point where we can throw key drawings at AI and let it handle all the inbewteens without a bunch of tweaking and cleanup afterwards it's going to really suck for places like Korea! I guess all those inbeatweeners will just be another victim of automation.

I've always loved animation, but I'll admit part of that comes from the hubris involved. It's pure insanity that people ever drew, by hand, mountains of individual drawings each slightly changed and assembled them into compelling illusions to tell stories. The amount of work that goes into animation is just staggering and anyone sensible would have rejected the entire concept as absurd. I wonder if animation will start losing part of its magic for me when it's done primarily by AI.

On the other hand though, another thing I've always loved about animation as a storytelling medium is that it isn't as limited by practical concerns like physics or reality. If something can be imagined, it can be drawn and animated if somebody has the skill and the resources to fund the massive amounts of work. It's time/money that forces animators to take shortcuts and make compromises. Creative decisions are made and rejected all the time due to those constraints. If AI driven animation gets more advanced to the point where that's no longer such a barrier it could create output more in line with the vision of creators and that's exciting too!

I hope that traditional hand drawn animation never dies, but I look forward to seeing how AI continues to change the industry and the output.

4 comments

> It's pure insanity that people ever drew, by hand, mountains of individual drawings each slightly changed and assembled them into compelling illusions to tell stories.

Traditional animation by itself is nothing short of insanity, convincingly blending live action and traditional animation takes it a step further, and then there's the "Bumping the Lamp"[0] scene in Who Framed Roger Rabbit.

The film as a whole refuses to keep the camera static to make things easy for the animators, which was unusual enough by itself, but then they went above and beyond — they casually bumped a pendant lamp and let it flail about. Every time it slows down, it gets bumped again. And they shaded and cast shadows for the damned rabbit for every single frame of that sequence. Madness.

0. https://www.youtube.com/watch?v=_EUPwsD64GI

This is not an example of AI handling the inbetweens.

This water-morph effect is undesirable for inbetweens.

You're right, but projects like this do make me think AI handling inbetweens well enough to replace animators is where we'll end up eventually and that it's probably not far off.
I don't want to burst your bubble, but it might happen anyway.

The artwork is inside a scene, SD does not understand that scene. The artwork has spatial and human readable emotional relationships. SD does not understand those relationships.

SD can maybe create morphs between frames, as a lateral move between two pieces of generated information, but it will never know how to connect up those images in a manner that satisfies the human requirement of creating a good image.

We already have mathematical tools for interpolating between frames. They are wholly unsatisfying for creating novel artworks. Adding SD to that stack doesn't magically solve that problem.

Your dream idea of killing the inbetween with mathematics would require automating what an artist does by hand to construct and bend space-time upon a blank piece of paper. Describing what an artist does takes time. CTRL+Paint does a good job. With mapping out every possible emotional/visual interpretation of those shapes, between the two frames and allowing the user to pick the resulting outcome.

That is the "tea, earl grey, hot" star trek replicator for art inbetweens. SD is just another tool for filling in gaps with random spam. The real value in this, is that there's a hoarde of young people who want SD and it's outcome. The real art will continue unphased, using SD as a tool, where it fits.

> but it will never know how to connect up those images in a manner that satisfies the human requirement of creating a good image.

A few years ago I heard people saying the same thing about going from a piece of text to a picture that "satisfies the human requirement of creating a good image"

Inbetweening is not going to be the obstacle that these AI approaches are finally going to be unable to manage.

If you say so Captain.
> never

Yeah, never say never. If AI can replace artists, it can replace animators, it can replace programmers, and ultimately it can replace humanity altogether.

I think we all knew this in the abstract but the pace is a bit faster than anybody expects.

> leaves me a little conflicted though. If we get to the point where we can throw key drawings at AI and let it handle all the inbewteens without a bunch of tweaking and cleanup afterwards it's going to really suck for places like Korea!

These comments on every single post are getting really boring.

You can probably expect them for any interesting technology forever into the future, since people have made these useless complaints for hundreds of years at least.
First they came for the horses….

And so on.

Well, today they're definitely coming for the artists I've stopped working with for side gigs since dall-e provides good enough results at zero cost and a fraction of the time necessary
>dall-e provides good enough results at zero cost

Even the direct costs of using OpenAI APIs are not zero.

for my needs I didn't have to shell out a single € yet
They really did come for the (human) computers, but we got way more jobs out of it than were lost.
Saddle makers had more than six days to prepare!
I think it's pretty normal for people to muse about the impacts future technologies are likely to have on people's lives, including those people who will find themselves out of work. I'm not even advocating that we try to turn back the clock or hold back progress to preserve anyone's careers because I think that'd be boring since it's pretty much settled (it's not going to happen and it's not worth trying to hold back progress).

While I can't expect it to interest everyone, I don't personally mind discussions of specific industries when it looks like their time is coming up though. Each industry is going to have to deal with the change in their own way and we'll all have to adapt in different ways. The more interested in the industry I am, the more interesting I'll find it's decline/collapse. Brace yourself, because when AI comes for the coders that topic is going to dominate this site for some time (at least until the AIs themselves start commenting)

this is very true