Hacker News new | ask | show | jobs
by orthoxerox 1491 days ago
DuckDB has become my preferred tool for hardcore data wrangling. Excel is fine for like 80% of data processing tasks, but the remaining twenty percent are a pain, especially when you're CPU bound on a remote desktop. Smuggling the DuckDB JDBC driver onto said remote machine was the most productive infosec violation I've ever committed.
2 comments

I don't know why I waited so long to try it.

I wrangle a ton of raw and aggregate data locally every day. I've had a 10-year habit of massaging via unix CLI tools and pipes then moving to excel. I guess I didn't wanna write code. Funny thing is I love SQL.

But with `duckdb_cli` it's a game-changer. I'm truly truly impressed.

> I've had a 10-year habit of massaging via unix CLI tools and pipes then moving to excel.

Have you, at any point, considered / used dgsh [0] or a similar tool? If so, how has been your experience with it?

[0] https://news.ycombinator.com/item?id=13352659

Interesting. Never tried dgsh before, but yea it looks like my poor-man's CLI workflow for a lot of tasks
Our lips are sealed.