Hacker News new | ask | show | jobs
by haldunanil 697 days ago
I can't speak to why it's popular, but I will say that the reason I chose it for one of my projects was because I pretty much had to as there were no better alternatives.

Most of the other tools like RAGAS and DeepEval are:

- Written in Python (vs. JavaScript like promptfoo), whereas our codebase is in Rails

- Get too into the weeds of AI, whereas I just want to write simple tests for my webapp not stare at a bunch of math equations

- Are hosted SaaS solutions (vs. open source like promptfoo) and I don't want to deal with the 6 month enterprise software sales cycle just to add a couple tests

So we basically ended up with promptfoo. That said, it felt really awkward to use promptfoo and I don't really love it. I'd love a super simple way to add some integration tests for an LLM so I can just keep iterating