Y
Hacker News
new
|
ask
|
show
|
jobs
by
rolisz
972 days ago
That's not quite tfidf though. I agree you can get better results than that with Ada embeddings, but I would argue you can get even better results with embeddings from smaller chunks.
1 comments
simonw
972 days ago
I guess technically it's bm25, since it's using the rank mechanism in SQLite FTS5:
https://www.sqlite.org/fts5.html#sorting_by_auxiliary_functi...
link