Hacker News new | ask | show | jobs
by sushshshsh 2135 days ago
That would explain why my ETLs are failing at 3am in the morning !!!
2 comments

If it makes you feel any better; same thing happened to me. Ugly Frankenstein process to get our data out of a third party vendor who can only e-mail us reports failed half-way through its run, and I was about to spend hours digging through to see why until I saw this.
Hehehe.... my condolences... we're still trying to recover
Your ETL processes write to google drive or are dependent on email?

Earnest question, don't mean to sound derisive.

User emails file to drive

script connects to drive and parses list of files within

script copies files into redshift and moves original file to different directory or deletes it

alas what can be done? this is what the company gets for building like this ^.^

My understanding is part of google cloud failed(Google Cloud Storage), causing many outages, including but not limited to google drive/email.
I'm assuming some kind of workflow which uses email notifications, and only goes to the next step if the email notification succeeds..?