[manmal]

Don’t the high end embedding services use a transformer with attention to compute embeddings? If so, I thought that would indeed capture the semantic meaning quite well, including the trait-is-described-by-direction-vector.

[realbenpope]

You are correct. https://deepmind.google/research/publications/157741/