[steveruizok]

We did a similar thing at tldraw with Draw Fast (https://drawfast.tldraw.com/) and it was very fun. Inspired a few knock offs too. We had to shut it down because it was getting popular on Russian Reddit. A related project Lens (https://lens.tldraw.com) also used the same technique, but in a collaborative drawing app.

At the peak, when we were streaming back video from Fal and getting <100ms of lag, the setup produced one of the most original creative experiences I’d ever had. I wish these sorts of ultra-fast image generators received more attention and research because they do open up some crazy UX.

[jschomay]

OP here, I remember both of the draw fast and lens demos! I'm pretty sure those were in the back of my subconscious, inspiring me to explore my take on real time rendering. Thanks for sharing your similar experience. I agree, this was a lot of fun to work on, and like one of the other commenters pointed out, experiencing it viscerally is a whole new kind of feeling, even with the consistency issues. I'd also like to see more experiments on what new kinds of UX could be possible with this tech.

[hiatus]

Is there any chance you'd open up the source for those projects so others can play with them?

[Topfi]

They've already shared it under a none-commercial use license: https://github.com/tldraw/draw-fast

The TLDraw team, from what I have seen, is really open in sharing their experiments under their own license. Not FOSS strictly, but I feel their licensing approach and decision is fair considering how they fund development, know that it's a contentious topic though for some.

[xienze]

According to that link, you're running the frontend locally but all the work is happening on fal.ai. So the interesting part is not open source.

[steveruizok]

Here’s a resource for more LCM models, which were built over Stable Diffusion. The inference provider is less a design piece than a detail.

https://huggingface.co/latent-consistency

[echelon]

LCM is what Krea used to gain massive momentum and raise their first $30M.

The tactile reaction to playing with this tech is that it feels utterly sci-fi. It's so freaking cool. Watching videos does not do it justice.

Not enough companies or teams are trying this stuff. This is really cool tech, and I doubt we've seen the peak of what real time rendering can do.

The rendering artifacts and quality make the utility for production use cases a little questionable, but it can certainly do "art therapy" and dreaming / ideation.

[dvrp]

hey thanks for the kind words (krea cofounder here). i agree with that! everyone’s focused on leaderboards and evals but not enough on higher order repercussions imo

on a related (but shameless plug) note, did you check our real time video rendering release?

> https://x.com/krea_ai/status/1961074072487620635