Hacker News new | ask | show | jobs
by enjoylife 1193 days ago
It’s essentially a question of did you take a look the code? There is comments in the codebase directly where the config values in question are being used. Eg.

> # repetition penalty from CTRL paper (https://arxiv.org/abs/1909.05858)

Now I’m assuming a base rate of knowledge for this to help, but in general I find diving into the code paths of open source models, usually is a good use of time.