[pillusmany]

The "ray" library makes running python code on multi core and clusters very easy.

[kroolik]

Although its great the library helps with multicore Python, the existence of such package shouldnt be an excuse not to improve the state of things in std python

[smcl]

Interesting - looking at their homepage they seem to lean heavily into the idea that it's for optimising AI/ML work, not multi-process generally.

[pillusmany]

You can use just ray.core to do multi process.

You can do whatever you want in the workers, I parse JSONs and write to sqlite files.