[dominotw]

SQL has taken over the space completely. 90% of data munging and transforms happen via SQL.

I would learn python. Its the number one language outside sql.

[sonofaragorn]

What do you use if you need to process hundreds of GBs of data?

[cjalmeida]

PySpark or Dask

[dominotw]

sql on snowflake

[walshemj]

Assuming the data is relatively clean in the first place - there is a lot of data sources where SQL would be an absolute swine to work with.