[zingababba]

What should be used instead?

[Hugsun]

I gave up after it didn't let me see the prompt that went into the LLM, without using their proprietary service. I'd recommend just using the API directly. They're very simple. There might be some simpler wrapper library if you want all the providers and can't be bothered to implement the support for each. Vercel's ai-sdk seems decent for JS.

[halyconWays]

>I gave up after it didn't let me see the prompt that went into the LLM, without using their proprietary service.

Haha, really?

[ebonnafoux]

httpx to make the call yourself, or if you really want a wrapper the openAI python https://github.com/openai/openai-python.

[dcreater]

Plain old http requests and your own functions.

Its almost always the better choice

[Jimmc414]

pydanticai, dspy or deal directly with the provider sdks

[dcreater]

DSPy seems like the right, developed approach but its far too convoluted and I find the grammar is ugly.