Hacker News new | ask | show | jobs
by laborcontract 747 days ago
Join q and a when vectorizing them. Questions alone are too short to carry a lot of semantic richness.

When you get a query, you then run two semantic search queries: one using the original question and one using a HYDE version of the question. Take those results and run it through cohere’s rerank.

1 comments

Yes, right now I'm vectorizing them as a pair. I'm then running a query in Pinecone by embedding the exact question but still the result does not have the actual q&a pair.

I'm not familiar with HYDE version. I'll check it out. Thanks for the suggestion