Hacker News new | ask | show | jobs
by simonw 1202 days ago
> If your JSON file is newline-delimited, DuckDB can parallelize reading.

I'd like to understand more about what that means. Does it use multiple threads each reading from a different position in the file?

1 comments

DuckDB will use multiple threads for reading the same file. Each thread will read different parts of the file, but the output will be in the order that the file came in due to DuckDB’s order preserving parallelism.