Hacker News new | ask | show | jobs
by bunderbunder 2787 days ago
Sorry, I misspoke - will edit. Was talking about resistance to overfitting. Which largely comes from logistic regression's assumption of a linear decision boundary. It's true surprisingly often in classification tasks, and, when it's not, you can usually model it just fine with interaction variables.

With an ANN, your easiest defense against overfitting is to have great big heaping piles of training data. That's something that's hard to come by in many interesting situations.

1 comments

Agreed. Logistic regression with poly kernel or good engineering interactions can equal or beat more complex models for a fraction of the budget.

All the more power to you if a solid simple logreg model (or even no ML at all) is your first deliverable.