[mattfrommars]

Are you using any kind of job scheduler to do the job for you in the background? Are you using Apache Arrow for job scheduling since you mentioned you need to apply to jobs behind the scene and spread out across day and night.

[PointedResponse]

Conveniently, I decided early on that I would rate limit applications based on the job board, so that any single user doesn't have too many applications sent to a single job board site like greenhouse or lever in one day. So for now, to spread them out I have an ec2 querying applications off the application postgres table every 15 minutes. It takes the next best job posting per board for each subscribed user and puts it into a queue to be processed. 1 application per user, every 15 minutes, with 1440 minutes in a day, means ~96 applications per user to any given job board per day. The applications are then processed off the queue by another ec2 synchronously to make sure only one posting is applied to at a time per user. In addition to the 96 application cap that comes naturally with this method, there is also a hard cap of 150 applications per day per board so that if the user is also going crazy using the "One-Click" applies, those in addition to the fully automated / "Zero-Click" applies won't get them flagged for spam by the board site.