Hacker News new | ask | show | jobs
by reichardt 990 days ago
Amazing! The inserted objects are renders of textured 3D models and not generated by a diffusion model + ControlNet? Is there a fixed set of textured 3D models available or are they generated on the fly based on the prompt?
1 comments

Thats correct! Right now, we're using the Blenderkit dialog, but we can expand beyond it. When you type a prompt and search though, that's actually doing a multi-modal search (so you can ask for a 'red painting' and it'll actually find a red painting), so it's insanely more accurate than a regular search. AI everywhere!
Super cool! Layout estimation for deprojection is a GNARLY problem especially because people love white textureless walls.

Tried some on fill3D from a dataset we had before (happy to share more), and yup: https://imgur.com/a/Ut2GwZ0

Tough Tough Tough!

fxn.ai looks super cool too, I might try it out!

Would love to get hands on that dataset, how can I reach you? Or, shoot me a note at yusuf@fill3d.ai