[bloopernova]

There's a shell script version of GNU parallel that's great for CI/CD pipeline tasks. You just keep it in your repo and source it as needed. It's incredibly useful, we use it in one build to batch process a few thousand things in groups of 25.

Edited to add: finally got signed in to work, you create the script via:

    parallel --embed > scriptname.sh

It's about 14,000 lines of awesome and works on "ash, bash, dash, ksh, sh, and zsh"

[notpachet]

Maybe this is a silly question, but what advantage do you get from checking that huge file into VC instead of just installing parallel ahead of time on the CI images?

[bloopernova]

Not a silly question!

In this case, we don't have control over the docker images used to build our apps.

[ilyt]

Parallel was born way before docker and modern CI practices. Having one script that did it all was more of a benefit before those become commonplace