Hacker News new | ask | show | jobs
by killerstorm 1536 days ago
This thing can't do 3D models.

There are some 3D image generation techniques, but they aren't based on polygonal modelings, so 3D artists are safe for now

2 comments

You could train a model on texture image data though, no?

Or what about even generating images you could then photogrammetry into models?

Yeah, there's a lot of 2D assets that this model would be great for (textures, materials, *maps, etc) that would definitely improve the asset-building process for game devs. I've already used VQGAN+CLIP for some low-res skill and item icons in hobby games and it seems things are only improving from here.

I wouldn't be surprised to see a comparable version for 3D models in the next year or two, though. Even if the current architecture doesn't lend itself to 3D structures (I don't know), there's a lot of parallel work being done right now (esp. by Google) for encoding 3D data in new/efficient ways, translating specialized 2D images into 3D models, and more.

Colab notebooks can do mesh models using this method, I'm certain OpenAI isn't far away