Hacker News new | ask | show | jobs
by cirgue 3144 days ago
> dead-simple algorithms

The most successful models I've ever built have been logistic regression models. If you can rephrase your problem in a way that's amenable to run-of-the-mill statistical techniques, you can frequently achieve much better results than you can with 'deep learning'.

2 comments

If you're going to do logistic regression, at least call it a single-layer neural network with a sigmoid activation function.
So true. I have had to do this.

I had a pretty good regression model but it was not taken seriously. So I wrote it using "a neural network in TensorFlow" and the next thing you know the whole company is asking me how it works and what it does.

This feels so dirty, but these kinds of tricks work. Your stakeholders get to participate in the titillating fiction that they are on the bleeding edge of technology, and you get to deploy a scalable, explainable, and (hopefully) high-performing solution. That's 95% of a win.
I'm totally "borrowing" that for later use.
Amen.. I like to use exotic techniques just out of intellectual curiosity and to put my education to use, but ultimately a basic linear regression is all people want! Ease of interpretation is paramount.