[switch007]

What languages are worth learning?

[dominotw]

SQL has taken over the space completely. 90% of data munging and transforms happen via SQL.

I would learn python. Its the number one language outside sql.

[sonofaragorn]

What do you use if you need to process hundreds of GBs of data?

[cjalmeida]

PySpark or Dask

[dominotw]

sql on snowflake

[walshemj]

Assuming the data is relatively clean in the first place - there is a lot of data sources where SQL would be an absolute swine to work with.

[johanneskanybal]

sql, python, terraform, maybe some basic java. Airflow is pretty common. Whatever the company is migrating away from. As long as you`re good at one of those and can pick up the rest on the fly you should be fine to start out.

edit: Guess this was pretty much in the post.