Hacker News new | ask | show | jobs
by karagenit 1866 days ago
Seems like the model likes to repeat words in the title, particularly when hyphens are involved (I guess it considers them as different words?) e.g. "new dinosaur-like dinosaur" and "male-pattern traits in male rats" are a couple I saw.
1 comments

That's mostly a GPT-2/Transformers quirk. Some approaches apply a repetition penalty to work around it.