[politelemon]

This was a difficult read, not necessarily due to the merry-go-round of trying to find the right fit, but the overhead involved and the maintenance burden this is going to become over time. Once it starts it's never going to be just another thin layer.

I'd prefer taking a step back to see if this is the right approach or if this safety can be solved in a much simpler way. Looking at the title of the submission I don't consider it practical. I would welcome any other ideas, I'm thinking along the lines of a simple and boring bff which does the parsing and validation and sending strongly typed objects to the front end.

[halJordan]

This is the same complaint people had against react itself and any other number of frameworks that introduce a higher level of abstraction. Take it or leave it but llms will require strong frameworks wrapping their output- output which will be structured/constrained heavily