Hacker News new | ask | show | jobs
by whenwillitstop 3441 days ago
Yeah I think the same thing. If we compare Hadoop to Spark, Spark is just easier and faster. It is superior in almost every way (unless we are talking about 1PB+ scale). I think data science will be automated. Some things wont, but engineers can already get pretty far by jamming data into ML packages.