|
|
|
|
|
|
by alexhans
58 days ago
|
|
|
This is what AI evals [1] and local llms should be a focus of your investment. If you can define good enough for you and local llms can meet that you'll get: - no vendor lock-in (control) - price - stability (you decide when to hot swap with newer models) - speed (control) - full observability and predictability. - Privacy / Data Locality (Depending on implementation of infrastructure). - [1] https://alexhans.github.io/posts/series/evals/measure-first-... |
|
|