[flatiron]

ive been playing with it locally in the hopes of a model that allows for commercial use. at my job if i had a model I could run in the cloud and just wrap a REST service around I could think of a ton of ways to use it both internally and externally.

[eurekin]

Thanks! If ChatGPT can be used commercially and it successfully passed SOC3 cert, wouldn't you still want to use those non - chatgpt models?

Also, you hint at those many ideas, could you elaborate on that a bit? I'll be playing with LLMs in near future, might as well do something useful with them

[flatiron]

my concern with using chatgpt is PII. If I host the LLM and set it up that it doesn't record any of the interactions besides some weird meta data and sign that in a contract i bet a bunch of my clients would like to use my LLM. especially if I can train it on internal documentation that they can't/won't send to a big third party like chatgpt. im one throat to choke and i already have their PII so i think its a good fit.

without getting into too much detail my job supports business to people interactions. my use case is training the LLM to assist the business agents. if it can give real time information that's helpful to the agent while causally listening to the conversation thats a pretty big game changer. also i want to use it for staffing decisions since it can view historic data and make recommendations for the future.

[UncleEntity]

How big of a model do you suppose it would take to come up with a Punctuation-as-a-Service cloud-based solution?

Asking for a friend…