Hacker News new | ask | show | jobs
by jeroenbourgois 2270 days ago
OP here (actually, he is my co-founder, same company). I can confirm this experience, looping seems to work.

In our own setup, we fetch data for the last 24h twice a day and then just insert everything. We have a db constraint on the message ID mailgun sends us, so only news ones will be persisted. We aren't even bothered with filtering before inserting, the db constraint does the trick.