Hacker News new | ask | show | jobs
by exyi 1365 days ago
Exactly, I almost started writing a tool for that, because nothing else I found supports arrays and composite types. Now let's hope DuckDB does support that :)

If you don't use arrays and composites, Spark should be able to do it, right?

1 comments

Yes, DuckDB supports writing lists and structs to Parquet! https://github.com/duckdb/duckdb/pull/2832

Does that help or do you have any other questions?

Awesome. However, the postgres_scanner has problems with jsonb, it won't even connect the database which contains those :/
Thank you for filing a bug, we will have a look at that I'm sure!
It's more of a feature request. Thank you :)