[ebfe1]

This is cool...Totally reminded me about several tools pop up on HN every now and then in the past for similar task so i did a quick search:

clickhouse-local - https://news.ycombinator.com/item?id=22457767

q - https://news.ycombinator.com/item?id=27423276

textql - https://news.ycombinator.com/item?id=16781294

simpql- https://news.ycombinator.com/item?id=25791207

We need a benchmark i think..;)

[sjellis]

I am currently evaluating dsq and its partner desktop app DataStation. AIUI, the developer of DataStation realised that it would be useful to extract the underlying pieces into a standalone CLI, so they both support the same range of sources.

dsq CLI - https://github.com/multiprocessio/dsq DataStation desktop app - https://datastation.multiprocess.io/

Two alternative CLI tools that I looked at:

sq - https://sq.io/ octosql - https://github.com/cube2222/octosql

Honourable mentions to:

Miller - https://miller.readthedocs.io/en/latest/index.html Dasel - https://daseldocs.tomwright.me/

These don't use SQL.

VisiData is also amazing for data navigation, although it requires some effort to get the model:

https://www.visidata.org/

[alserio]

xsv is invaluable for processing big csv files: https://github.com/BurntSushi/xsv

[thejosh]

qsv is a fork of this, as qsv is pretty much unmaintained now (I don't mean to sound negative, BurntSushi did an AMAZING job and I love the work they did).

[alserio]

Didn't know that. Thanks!

[tanin]

Shameless plug. A desktop app: https://superintendent.app

[wodenokoto]

It looks really nice.

I’ve spend what feels like too much time looking for a windows app that I can use to occasionally preview CSV files before moving them into WSL.

I just think $50/year is too much for occasional use.

Since this posts has initiated several other shameless plugs, maybe I can swoop in and ask for shameless recommendations for something cheap in this space.

[tanin]

Thank you for your kind words. Could you elaborate your use case?

Drop me an email at tanin@ superintendent.app, we should be able to work something out regarding pricing.

[ebfe1]

we need more shameless plug on this thread ... the more benchmark, the better! I think this would be a fun weekend afternoon :)

[eirikbakke]

Another shameless plug, then: https://www.ultorg.com

This one is another desktop app, with a slightly different approach: in the CSV file case, the data is parsed and dumped into a bundled PostgreSQL database, which you can then query with a visual query interface.

[tstack]

Oh, okay... https://lnav.org is a log file viewer for the terminal that integrates with SQLite so you can use SQL to query your log files.

No benchmarks, though.

[marklit]

I'll save you the trouble, ClickHouse will come up on top by a mile and is the only one listed that supports clustering and spill to disk.

[antman]

Groupby and joins are a good test. You could also give Duckdb cli api a try (it is column based)

[mattewong]

another shameless plug: https://github.com/liquidaty/zsv