Hacker News new | ask | show | jobs
by fixprix 459 days ago
I recently got into creating avatars for VR and have used AI to learn Unity/Blender so ridiculously fast, like just a couple weeks I've been at it now. All the major models can answer basically any question. I can paste in screenshots of what I'm working on and questions and it will tell me step by step what to do. I'll ask it what particular settings mean, there are so many settings in 3d programs; it'll explain them all and suggest defaults. You can literally give Gemini UV maps and it'll generate textures for you, or this for 3d models. It feels like the jump before/after stack overflow.

The game Myst is all about this magical writing script that allowed people to write entire worlds in books. That's where it feels like this is all going. Unity/Blender/Photoshop/etc.. is ripe for putting a LLM over the entire UI and exposing the APIs to it.

6 comments

> The game Myst is all about this magical writing script that allowed people to write entire worlds in books. That's where it feels like this is all going. Unity/Blender/Photoshop/etc.. is ripe for putting a LLM over the entire UI and exposing the APIs to it.

This is probably the first pitch for using AI as leverage that's actually connected with me. I don't want to write my own movie (sounds fucking miserable), but I do want to watch yours!

I have this system 80% done for novels on my machine at home.

It is terrifyingly good at writing. I expected Freshmen college level but it's actually close to professional in terms of prose.

The plan is maybe transition into children's books then children shows made with AI catered to a particular child at a particular phase of development (Bluey talks to your kid about making sure to pick up their toys)

I think there's a big question in there about AI that breaks a lot of my preexisting worldviews about how economics works: if anyone can do this at home, who are you going to sell it to?

Maybe today only a few people can do this, but five years from now? Ten? What sucker would pay for any TV shows or books or video games or anything if there's a comfy UI workflow or whatever I can download for free to make my own?

It breaks economics in a good way. Less resources spent on all kinds of media and other things is deflationary. Prices go down, a single person can provide for a family working less hours.
How is this good in any way for the creative workers? Do you think there's a sustainable source of innovative and interesting experiences being generated if no people wrote anymore?
It's good for everybody. We have to work less to survive. Everyone is more productive at whatever they do. The value is in the ideas not the medium. You might write a book and I'll take it and use AI to turn it into audio, or a tv series, or a movie, or a video game.

The bottleneck is no longer on labor to turn ideas into reality, the bottleneck is imagination itself. It's incredible. The cost to produce/consume going down along with many other facets of the economy translates into deflation.

If you make less money, or work less hours, or only have a single person in your family work - that's ok because money will go further. That's the whole idea behind Star Trek, the first step though was intelligent computers, automation and robots. Harnessed in a way that doesn't backfire on us.

This would be true if it was doing it with essentials like food, healthcare, housing, transit, but it's not.
What sucker would pay for any TV shows or books or video games or anything if there's a comfy UI workflow or whatever I can download for free to make my own?

I think it's about time the industry faced that risk. They have it coming in spades.

For example, LOST wouldn't have been such a galactic waste of time if I could have asked an AI to rewrite the last half of the series. Current-generation AI is almost sufficient to do a better job than the actual writers, as far as the screenplay itself is concerned, and eventually the technology will be able to render what it writes.

Call it... severance.

Only few are both capable and willing to take on creative tasks, with AIs or not. Boring people cannot form strong enough cohesive thoughts that can drive an AI, even if AI output itself were not as boring as they are.
The ‘professional level’ prose to which you refer: “ABSOLUTE PRIORITY: TOTAL, COMPLETE, AND ABSOLUTE QUANTUM TOTAL ULTIMATE BEYOND INFINITY QUANTUM SUPREME LEGAL AND FINANCIAL NUCLEAR ACCOUNTABILITY”

Even if AI prose weren’t shockingly dull, these models all go completely insane long before they reach novel length. Anthropic are doing a good job embarrassing themselves at an easy bug-catching game for barely-literate 8-year olds as we speak, and the model’s grip on reality is basically gone at this point, even with a second LLM trying to keep it on track. And even before they get to the ‘insanity’ stage, their writing inevitably experiences regression towards the average of all writing styles regardless of the prompt, so there’s not much ‘prompt engineering’ you can do to fix this.

This has not been my experience. Which models are you using? The AI's all seem to lose the plot eventually.
The value of art is that it's a human creation and a product of human expression. The movie you generate from AI is at best content.
You should check out Blender MCP, which allows you to connect Claude Desktop/Cursor/etc to Blender as a tool. Still early days from my experiments but shows where it could go https://github.com/ahujasid/blender-mcp
This looks great! Do you think you might add an option to use the model linked here instead of Hyper3D?
I have never seen knowledge to be the limiting factor in success in the 3D world, its usually lots of dedicated time to model, rig, and animate
It's often the limiting factor to getting started, though. Idiosyncratic interfaces and control methods make it really tedious to start learning from scratch.
I don't think they are idiosyncratic. They are built for purpose, one simply lacks what to look for. Same for programming really.

I also think that using AI would only lengthen the learning period. It will get some kind of results faster, though.

If you need time dedicated to it, knowledge is the limiting factor.
You tried sharing your screen with Gemini intead of screenshots? I found it sometimes is really brilliant and sometimes terrible. It's mostly a win really.
I just tried it for the first time and it was a pretty cool experience. Will definitely be using this more. Thanks for the tip!
Look up blender and unity MCP videos. It’s working today.
Watching a video on it now, thanks!
> Unity/Blender/Photoshop/etc.. is ripe for putting a LLM over the entire UI and exposing the APIs to it.

This is what Windows Copilot should have been!

I'm sure they're working on it. This MCP stuff is early days. Even I am just finding out about it's integration into Blender and Unity in this thread.
There's already MCP's for both blender and unity and figma already