Hacker News new | ask | show | jobs
by jorblumesea 2510 days ago
Does anyone not want to become a ML engineer? Is this the future, and will we even have a choice or else be out of a job?
5 comments

There's plenty of non ML software engineering to be done. Anecdotally a large proportion of interns want an "ML project", but only a small percentage of teams looking for interns are offering one.

Too many people going into ML could skew the supply/demand into making it a worse job option (more work, less pay), like game programming or academia.

There aren’t that many engineers with 10+ years of ML experience ATM, but there will be tons in 5 or so years. Chasing tomorrow’s trend is always more productive than chasing today’s, but of course the former requires predicting the future.
The question is this: 10 years from now when the top job requirements list ML - are you going to be ready or out of the game?
Alternatively the market is flooded with ML people and the value of ML on your CV is 0.
I got an offer to do ML on video data recently, but turned it down to do some non-ML software eng. instead, for double the money. The ML work would be way cooler, but it would at a startup (=stressful) and double the money means half the time to reach FIRE.

The caveat is that I've worked on ML in the past and I think that the work is maybe less intellectual than software engineering - with complex enough models they become impossible to understand and you start to just try out ideas based on random intuitions. The thing I mostly like about it is the ability to use math and more independent style of work - no scrum, less need for cooperation with other team members etc..

I started in ML about 7 years ago so well before the hype and back then very few people wanted to be ML engineers.

What's happening at least in Australia now is that contract rates (a good indicator of the supply/demand ratio) has halved for ML engineers. Which means (a) a lot of people want to be ML engineers and (b) there aren't that many jobs for them.

Just to be sure I understand correctly, you’re saying that money has halved for ML engineers because plenty of people are getting into ML and are willing to take much less money? You said they “want to be” ML engineers which implies they aren’t really and thus aren’t worth ‘full-rate’
ML engineer is a super boring job content-wise and has insane outside pressure. It's about building data pipelines, the ugly grunt work. ML/Data Scientist is the interesting job. Usually Data Scientists view ML Engineers as replaceable drones that don't understand anything interesting and do the boring part of the job for 2-3x less than they do. The only advantage of ML Engineers is that AutoML is unlikely going to replace some dirty work but might endanger outdated Data Scientists.
I might disagree on this. The software engineering behind production machine learning systems can be quite interesting and nontrivial. It really depends on the scope of the challenges being faced. If you have thousands of models that need to be served in production and continually retrained and monitored, that becomes a pretty sophisticated problem space to work in.
Yes, however most ML engineers don't get to work at Jeff Dean's level to actually do such interesting work. There are very few companies willing to write their own Horovod or distributed PyTorch.
Except for the part where data science is an incredibly broad term and the majority of the positions are seemingly what used to be called 'data analyst'.

It makes finding good positions really hard.

the vast majority of ML/data scientist positions are actually similar to the hypothetical ML engineer position you described.
Well, you could save money and use it to feed yourself while learn new skills when you're out of a job. That works too.