Hacker News new | ask | show | jobs
by condwanaland 970 days ago
I wish they did though. 80% of my day job is (admittedly non-traditional) ETL. It's done in 100% PySpark.

More composable than SQL. Have plenty of utility functions wrapped up (which are far easier than stored procedures) in libraries. The code is far easier to step through with a debugger (due to the composability).