Hacker News new | ask | show | jobs
by KRAKRISMOTT 1205 days ago
> I was recently thinking of a backend for code execution for LLMs. It's hard to run Python safely in a box.

Sandboxing Python can be done fairly easily with either WebAssembly or a low profile hypervisor solution like Firecracker. See the Toolformer paper for more uses of connecting LLMs to existing technical infrastructure. You might also find the ACT-1 transformer to be somewhat relevant.