|
|
|
|
|
by verdverm
88 days ago
|
|
1. Not using their tools / pre-paid plans, the incentives do not align. Instead, using the APIs and paying per token directly. I built a custom agent stack and can optimize in ways they will not. Limits are also much higher, especially if you spend more. Anecdotally, it doesn't seem like the serve quant'd models when using the API directly, during busy times. 2. Staying in the loop. The underlying LLMs still make too many mistakes and churn to be left to their own devices yet. You have to think and evaluate deeply if your current setup is actually producing benefits while saving time. |
|