[jrvarela56]

My hunch is that if you try to build your solution with the constraints enforced by Heroku your system will be more resilient.

If it's about being easy to dump stuff to disk, using S3 or even Postgres for something like this could become easy after a few attempts. Another pattern that would come out of this exercise is trying to deal with that job in parallel by breaking it up into sub-tasks (many workers at the same time).

Anyway, too little context for me to flesh out a solution but the gist is that in general these constraints nudge you in a 'healthy' direction when designing systems.