Hacker News new | ask | show | jobs
by version_five 1269 days ago
That's very interesting. Do the train and val set losses both show that behavior? I did a very similar experiment earlier this year - in my case it was a classifier where images could be categorized different ways, and my takeaway was making it predict more classes improved performance. I'll have to go back and look at the loss curves during training and see if the improvement is immediate as in your case
1 comments

Before one epoch, both the train and eval curves look pretty much identical. Quite curious