[tudorw]

I think that's going to be a geodesic in a hyper-dimensional manifold. There was an article here about 'wordlets' on a hyper-sphere and a piece on time and LLM and the relating manifold. Visualising LLM topology (multi-dimensional topological manifolds) is a very rich area for exploration. I'm waiting for someone to use PHATE to do the dimension reduction, it's used in neuroscience to reduce dimensionality providing information not visible using PCA, t-SNE, LDA or UMAP.

[patcon]

Yep, been thinking on that paper as well:

Traveling words. There's code! https://arxiv.org/abs/2309.07315

https://github.com/santiag0m/traveling-words

[tikimcfee]

This is so damn cool! You just showed me something that may change the course of my ideation, current project, and who I may talk to. Thank you so much for sharing.

Words in space. It’s finally freaking happening!!!

[patcon]

:)