Hacker News new | ask | show | jobs
by pillefitz 1040 days ago
That is essentially what embeddings do
1 comments

Maybe, except from my understanding an embedding vector tends to be much larger than the source token (due to the high dimensionality of the embedding space). So it's almost like a reverse compression in a way. That said I know vector DBs have much more efficient ways of storing those vector embedding.
Tokens are not 1:1 with vectors.