Hacker News new | ask | show | jobs
by Der_Einzige 25 days ago
You can fix looping with proper repetition penalties. Turn on the one called “DRY” that PeW invented and got merged into llama cpp
1 comments

I added repetition penalty of two. I do not know. Maybe it is not applied correctly somehow by llama swap, that I am using, but I do not consider it that much of a nuisance to so I did not tried to fix it yet.

Do you have this DRY docs?