Hacker News new | ask | show | jobs
by yelmahallawy 107 days ago
Do you play with the temperature/top k parameters at all?
1 comments

No. I also use the least sophisticated but fastest model that Amazon hosts - and it hosts all of them except OpenAI models - Nova Lite

Going from free text to tool call with parameters in the grand scheme of things is one of the easiest things to do especially when you only have a limited number of tools.

Makes sense, simpler=better. Thanks!