[dartos]

Searching in LLM land is finding the cosine similarity of two high dimensional vectors. Vector databases try optimizing that operation.

Maybe they found search by plain old dot product faster

[akomtu]

Cosine what? Isn't it just dot product?

[dartos]

There are a few “distance” metrics that are used.

AFAIK cosine similarity or cosine distance is a common one bc it’s faster than a dot product.