|
|
|
|
|
by KRAKRISMOTT
1205 days ago
|
|
> I was recently thinking of a backend for code execution for LLMs. It's hard to run Python safely in a box. Sandboxing Python can be done fairly easily with either WebAssembly or a low profile hypervisor solution like Firecracker. See the Toolformer paper for more uses of connecting LLMs to existing technical infrastructure. You might also find the ACT-1 transformer to be somewhat relevant. |
|