Hacker News new | ask | show | jobs
by pshc 2176 days ago
Would you say you found a result similar to the lottery ticket hypothesis? https://arxiv.org/abs/1803.03635
1 comments

Not really - I had to do multiple steps of 'prune a bit, train a bit' to be able to prune to 99%. If I had done all the pruning in one big step as they do, I don't think it would have trained well, even if I had been able to see the future and remove the same weights.