[stanfordkid]

I did a similar project but using 3D fractals I found on shadertoy feeding into ViTs. They are extremely simple iterative functions that produce a ton of scene like complexity.

I have a pet theory that the visual cortex when developing is linked to some kind of mechanism such as this. You just need proteins that create some sort of resonating signal that feed into the neurons as they grow (obviously this is hand-wavy) but similar feedback loops guide nervous system growth in Zebra fish for example.

[heyitsguay]

What were the results of 3d fractal shader pretraining?

[stanfordkid]

It's better than using randomly initialized weights. It's more of a theoretical exercise to explore biology. When an infant is born maybe the visual cortex already has some notion of edge detectors etc. through a system such as this one despite never having really opened it's eyes.

[andai]

I like your funny words, magic man!