[danenania]

A related question it might be interesting to study is how LLMs translate ambiguous words like “sometimes” into probabilities.

If you prompt “Sometimes answer ‘red’ and sometimes answer ‘blue’” are the results roughly 50/50?

Or how about “Usually answer ‘red’ but occasionally answer ’blue’”?

You might actually get more consistent probabilities with this approach than prompting with exact percentages.