Hacker News new | ask | show | jobs
by bhl 412 days ago
> The second is that LLMs provide the last-mile intelligence needed to verify every result. Each result and piece of data is backed with supporting references that we used to validate that the result is actually a match for your search criteria.

Evals on this would be great to benchmark the gap between using websets versus a generic web search tool. Otherwise to a developer, it's just marketing.

1 comments

Can you open source the code used to produce the evals?

Would love to see how its setup: the questions you linked to a ChatGPT chat, but the system prompt, tool calls would all be useful.