[airocker]

But what if there is a bad model that fine tunes with only tools?

[Joschkabraun]

What do you mean with being a bad model?

If the model is really good at tool use, then it will broadly useful as it needs capabilities to generate the tool definition. So, there should be some transferability.

[ec109685]

If the exact tools test was part of the training of the model, wouldn’t that throw off the results and not generalize?