[incognito124]

If you're interested in not reinventing the sandbox for LLMs, consider Judge0: https://judge0.com/

I have absolutely no relation to the project except for the fact that I went to the same Uni as the creator.

[simonw]

That one looks pretty good - it's been around since 2016, I'm surprise I haven't encountered it before.

It's not quite right for what I'm after because you can't just "pip install" it on multiple platforms.

[dizhn]

Do you know if it has any kind of orchestration/queue support or if there's another project that does it embedding Judge0?

[incognito124]

No idea, I expect that it does since it's very performant. I would totally reach out to the support

[era86]

I'm using judge0 for a Leetcode-clone I'm working on. Never thought of using it in the context of LLMs, though.

[christoff12]

This looks like something I can use for a project I'm working on. Thanks