[datacog]

Thanks!

Are these methods main stream? Esp. the layered RF, how good/bad does it do as compared to regular ones?

[agibsonccc]

Not particularly. The desire of neural networks here are the non linear transforms you can do with the data. There's definitely some appeal and things to try here though. Gradient boosted trees and other attempts to augment random forest are pretty main stream though.

[ajtulloch]

Nit: gradient boosting isn't an 'augmentation' of random forests - if anything, it's the other way round. AdaBoost is from 1995, the GBM paper was 1999, and Breiman's random forest paper in 2001 explicitly couches it as an enhancement to AdaBoost.

[agibsonccc]

Good point! Terrible wording on my part.