[mkmk]

If I'm understanding correctly, this makes all of the functions available to gpt-4 at once and then gpt-4 decides which one to use, right? What are the limits on the number and length of functions, and is there any way to choose only a subject of the functions to share for a given user query?

[NickNaraghi]

Pretty cool that this is a recreation of expert systems, which was a dominant approach to building AIs for decades :)

[__loam]

Expert systems except it's like 400 times more expensive to run.

[jacquesm]

Sure, but also 400 times (at least...) more versatile and more error prone.

Determinism was one of the things that the expert systems of old did reasonably well. The current incarnation feels like playing Russian Roulette but with three bullets rather than just one.

[jrmyphlmn]

You're right!

IIRC, only the function signatures (or descriptions) are counted as part of the context window so you could add as many till you exceed that limit. Since the contents of the function itself are not counted, your function can be whatever length.

> is there any way to choose only a subject of the functions to share for a given user query?

As of now, no. I can see why this may be a problem soon since right now all functions are available for gpt-4 and each call can become expensive pretty quickly if you send like 50 functions every time.

I'm not sure how to address this yet, but I'd like to think of it as some form of fine-tuning that happens after having a few conversations. Will keep you in the loop!

[mkmk]

Ah, that makes sense. So on their end they’re just passing the descriptions to the llm (plus some wrapper to let it know it’s a func) and then they pipeline the data in and out of the chosen function. That has always confused me but I think I get it now. Thanks!

[nurple]

Sure, give the LLM a discovery function. If you're trying to figure out what tools to give the LLM based on user input, you're probably squandering the main power of the pattern.