Hacker News new | ask | show | jobs
by jairuhme 873 days ago
Are you looking to test different prompts on a set of questions? I have not found anything that specifically does this. When I have tested different prompts, it has just been with a short script iterating through the questions/prompts. Could be a fun project to build something where all you do is add the prompts you'd want to test, but the challenge that first comes to my mind is creating the question set to be used.

As I write this, when you say you want to test prompts, are you looking to test the system prompt on a set of questions or is the prompt the question and just asked in different ways?

1 comments

I want a simple, reliable way to confirm if putting "OUTPUT IN JSON PLEASE!!" in capitals with two exclamation marks is more effective than just "output in JSON".