|
|
|
|
|
by jbellis
45 days ago
|
|
> Batches all operations. Does large number of reads/edits simultaneously... I wasn't sure what this meant, so I looked at the source. It seems to be referring to tool APIs being designed around taking multiple targets as a list parameter, instead of hoping the model makes appropriately parallel tool calls. (This matches my experience btw, models are reluctant to make a large number of parallel calls simultaneously, and this seems more pronounced with weaker models.) |
|