Hacker News new | ask | show | jobs
My Battle with Datetimes in Prod (datacompose.io)
5 points by tccole 180 days ago
2 comments

I spent 8 hours debugging datetime parsing in a PySpark migration. Every solution failed… built-in functions returned silent NULLs, UDFs took 6 hours to run, pandas UDFs still failed on 8% of rows.
>> Date inference is genuinely hard—there’s no universal standard

Umm, ISO is the universal standard