Anyone deploying LLMs in production at a startup?

[LuisLiuYC]

I would love to chat with anyone who has experience deploying LLMs in a startup context. I’m especially curious about how security considerations factor into the deployment process. Would really appreciate your insights!

[raooll]

Hey, are we talking about deploying a LLM server here or LLM powered applications ?

[LuisLiuYC]

LLM powered applications

[raooll]

I have deployed a few. One with a million registered users.

[LuisLiuYC]

Cool! Would you mind if I interview you for 15 minutes? Here is my linkedin if you want to connect over there! www.linkedin.com/in/luis-liu-li

[raooll]

sent