|
|
|
|
|
by nlarew
442 days ago
|
|
> What is there to standardize? At a high level, the request format and endpoints. Instead of needing to write a bespoke connector for every type of context that matches their preferred API standards, I just tell my client that the server exists and the standard takes care of the rest. Do you have similar doubts about something like gRPC? > This looks like micro services crossed with AI. Seems like a cynical take with no substance to me. What about a standard request protocol implies anything about separation of concerns, scaling, etc? |
|
I think we fundamentally disagree on what "request format" means in context of a large language model.