[ting0]

Does it matter though? If it accomplishes the task, it accomplishes the task. Everyone uses a harness anyway, and finding the best harness is relevant. Also perhaps this hints at something bigger, i.e.: we're wasting our time focusing on the model when we could be focusing on the harness.

[stephantul]

Yes it matters, because it’s not a measurement of whether it accomplishes the task if a human tells it how to solve it.