Hacker News new | ask | show | jobs
by neuralnetes-COO 758 days ago
This is the purpose of LLMOps. To provide guardrails for precise output to prevent hallucination.
1 comments

This is the first I'm hearing of LLMOps, please elaborate a bit on what it entails. How does it provide guardrails?
Basically, do you want a pipeline/process that utilizes LLMs and provides exactly the output you want? How do you formalize a human expert workflow using LLMs? With LLMOps. It is new, there is no standard or predefined resource that I'm aware of. At neuralnetes we are creating all of our methods ad hoc and use tight feedback loops to ensure ideal, precise output.
That sounds like technical editing but for LLM output instead of technical writers.
It's mostly software engineering.
Sounds like it's mostly air unless you can point to an LLM that doesn't confabulate.
No need to set impossible standards here, the correct thing to ask is whether the guardrailed LLM confabulates less than its competitors. That sounds like a useful job to have.