Hacker News new | ask | show | jobs
by klibertp 1871 days ago
And pay in memory for that luxury: when using lots of complex libraries (like in ML) the Python process can eat quite a lot of RAM.
2 comments
viraptor 1871 days ago
Since gc.freeze() got implemented (https://docs.python.org/3/library/gc.html#gc.freeze) having forked workers has much lower cost these days. As long as you can load your data pre-fork that is.
link
klibertp 1871 days ago
Wow, I missed its introduction. Nice. On a cursory glance Celery doesn't make use of it yet, unfortunately.
link
globular-toast 1871 days ago
Yes. Python is not without tradeoffs.
link