[jsyolo]

or sqlite for CSV/TSV, haven't tried it for json.

[ydant]

duckdb and being able to write:

   select a,b,c from '*.jsonl.gz'

has been a huge improvement to my workflows.

[zX41ZdbW]

How does it look from command-line for streaming processing of CSV/TSV?

[jsyolo]

you can pipe to it

[nousermane]

Yep:

  $ cat foo.tsv

  name    foo     bar
  Alice   10      8888
  Bob     20      9999

  $ cat foo.tsv | sqlite3 -batch \
    -cmd ".mode tabs" \
    -cmd ".import /dev/stdin x" \
    -cmd "select foo from x where bar > 9000;"

  20