Ask HN: Is anyone running local LLMs in their organization?

[harry8]

What is HN's experience of running local LLMs inside an organization? What hardware? What model? How is it resourced? How is access and usage managed? What question should I be asking about it if you're doing it? What's interesting?

[senza1dio]

you can use this!! it works fine!

https://nothumanallowed.com/local