[coffeebeqn]

So it seems like they still use vectors - they just replaced the search (however that works) with a dot product operation? I mean from a vector point of view that makes total sense

[dartos]

Searching in LLM land is finding the cosine similarity of two high dimensional vectors. Vector databases try optimizing that operation.

Maybe they found search by plain old dot product faster

[akomtu]

Cosine what? Isn't it just dot product?

[dartos]

There are a few “distance” metrics that are used.

AFAIK cosine similarity or cosine distance is a common one bc it’s faster than a dot product.