Hacker News new | ask | show | jobs
by glogla 1177 days ago
Parquet doesn't really do timestamp with time zone. Also relevantly for processing Parquet, Apache Spark doesn't really do timestamp with time zone. Meaning that if your data go through parquet (e.g. in a data lake) you have to store timestamps as strings, or lose the time zone.

It sucks.

1 comments

We went for the 3. option, store the timezone in a separate column for data where the timezone is needed.