Hacker News new | ask | show | jobs
by IanCal 496 days ago
It is labour intensive to optimise a prompt though. Particularly for smaller models.

Setting parameters for any ml model is easy, but we'd call it labour intensive if we expected people to do it manually despite having evals. Instead we have ways of searching for and optimising settings. The methods for that are obvious for small cardinality discrete values or continuous variables. Less so for arbitrary text.