[aftbit]

Is anyone using any of these services? The only one I actually recognize from their list[1] is Triton Inference Server.

1: https://github.com/protectai/ai-exploits/tree/main/nmap-nse

[ianbutler]

I recognize most of them, they're all pretty common orchestration, distributed computation, or experiment management tools. Maybe you're just not as integrated on the operations portion of the ML space?

[wolftickets]

[I work at Protect AI] - The goal here was initially relatively common tooling around MLOps/Data Science work. All ears here if you have some ideas for other projects to explore.

[swatcoder]

The purpose of the repo seems to be to collect an archive of what real-world vulnerabilities look like, to inform service implementors and security researchers in their future work.

I suppose I’m idly curious about the answer to your question too, but paying too much attention to the specific targets feels like it’s missing the point and purpose of the collection.

[spmurrayzzz]

h2o is definitely somewhat popular specifically for LLMs, but ray is certainly widely used for distributed training workloads