Hacker News new | ask | show | jobs
by sayonaraman 1723 days ago
Whoever wrote the article must have done a cursory search at best, I'm surprised they didn't mention semantic hashing by Salakhutdinov & Hinton (2007) https://www.cs.utoronto.ca/~rsalakhu/papers/semantic_final.p...

Edit: also, talking about LSH, must check out FAISS library https://github.com/facebookresearch/faiss and the current SOTA http://ann-benchmarks.com/

3 comments

I'm intrigued by FAISS. Do you know if I can use BERT embeddings with FAISS?
Yes. Check out this example with Faiss + Bert: https://www.pinecone.io/learn/faiss-tutorial/
This tutorial was excellent. I got everything working in a couple of hours. On CPU alone the similarity search is mindbogglingly fast. Thank you!
We will add neural hash based ANN to that repo when we get time. I expect HNSW to get pushed out in time for many reasons.
Interesting. Hadn’t seen it actually. BOW is problematic as a starting point, but this is neat and a long time ago too.