Hacker News new | ask | show | jobs
BSD_Evals: Open-source LLM evaluation tool (github.com)
1 points by bsdpython 808 days ago
1 comments

How do you know which LLM is the best option to use for your particular use case? I published an open source repo to evaluate models based on your own set of prompts across Anthropic, Google and OpenAI. Besides model evaluation, it can also be useful for prompt engineering, API response time benchmarking and production application monitoring.