Hacker News new | ask | show | jobs
by roncesvalles 64 days ago
I've seen Big Data pipelines (Hive tables, Spark jobs for queries, data engineers setting it all up) for what was ultimately a 5-10 GB dataset.

Companies cargo culting Big Data stacks when their data is nowhere near big is very prevalent.