|
|
|
|
|
by Akula112233
457 days ago
|
|
> Can it run completely on prem ? Yep we have an on-prem offering as well, got similar notes from folks before! > What stops me from building my own logger that sends a request to write a record to a DB and later asks an LLM what it means ? Great question! The main limitation over brute force is the sheer volume of noise, and therefore relevant context. We tried this and realized it wasn't working. From a numbers perspective, at even just 10s of GBs/day scale of data (not even close to enterprise scale), mainstream LLMs can't provide the context windows you need for more than a few minutes of operational data. And larger models suffer from other factors (like attention diffusion / dilution & drift). > I see the landing page. The pricing should be clear though “ Contact Us” is scary.
Noted! |
|
I hope my tone wasn’t too brash.
If you can update the pricing I might be able to pitch this to my org later this year. We’d definitely like an on prem solution though!