The only LLM library I've found at all useful is Microsoft's Guidance lib. Otherwise, I just do things by hand.