Hacker News new | ask | show | jobs
by prions 2977 days ago
Really interesting article seeing how I'm finishing up my own DCGAN project!

Generative models like GANs are fascinating, but very temperamental to train. Some of the findings in this paper mirror my own observations - increasing the complexity of the GAN adds a lot of instability. My solution was to keep things as simple as possible. I spent a lot of effort trying to increase the size of the network to get better results, but in the end my smallest implementation worked the best.

This bit is interesting: "Without progressive growing, all layers of the generator and discriminator are tasked with simultaneously finding succinct intermediate representations for both the large-scale variation and the small-scale detail. With progressive growing, however, the existing low-resolution layers are likely to have already converged early on, so the networks are only tasked with refining the representations by increasingly smaller-scale effects as new layers are introduce"