[murb]

This is a wonderful idea.

We've slowly been baking more and more logic into the AI nodes to make them easier to use. Adding categorizer and scorers instead of forcing people to define their own functions was a game changer. Definitely the direction we want to head in, thanks for the suggestion.

[cuchoi]

This might be useful for this: https://github.com/outlines-dev/outlines

[mdaniel]

https://github.com/outlines-dev/outlines/blob/7fae436345e621... squares with my experience using LLMs for anything real

  sequence = generator("Alice had 4 apples and Bob ate 2. Write an expression for Alice's apples:")
  print(sequence)
  # (8-2)

Then, there's a whole process around feeding the output of one LLM into another LLM for checking the checker .. I'm glad it works for some people some of the time to get some gains over 'doing it the old way'

[murb]

Woah never heard of this repo but looks spot on. Checking it out now, thanks for the share