Hacker News new | ask | show | jobs
by Raz0rblade 4630 days ago
But just keep in mind that neural networks beyond 4 layers are often not better. and most work can be done with 3 layers total.. (so that is one hidden one), having two hidden ones can just do some things that a 3layer cant.

But more then 4 is more often a bad design and usually overkill of layers for most practical usages.

Although theoretical there no math limit to the amount of layers in practical terms its more often calculation time that explodes to unless its a simple FANN based network but then still 3 or 4 layers is 95% of the time enough

1 comments

I've heard this many times. Not contradicting it (I believe it, for the tasks we tend to give ANNs, anyways) Do you have a good review/citation for this?
thanks, this is perfect.