Hacker News new | ask | show | jobs
by OrangeMonkey 1434 days ago
All knowledge is worth having and the pursuit of this knowledge will help us become more than we were. I appreciate that.

That said, consider the path of the warehouses over the last 20 years. Previously, you needed teams of data developers and engineers with modeling experts to put forth a datawarehouse that may solve a companies problem. Now, you _can_ toss very wide tables in a cloud data platform (snowflake, redshift serverless, synapse) and it likely will 'just work'. Sure it can be faster, but these problems are being slowly removed from something we have to care about.

I'm a data specialist, and my knowledge is going to be worthwhile for a good long time, but the premium that exists for it will go down I think.

1 comments

Actually, this has been false or at least highly questionable for quite some time.

"Command-line tools can be faster than your Hadoop cluster"

http://aadrake.com/command-line-tools-can-be-235x-faster-tha...

https://news.ycombinator.com/item?id=8908462