Right, a glance at the new Assistant API docs, which seems to mirror ChatGPT in functionality, suggests that the "Assistant" determines which tool to use, or which models to use (code or chat) to generate a response message. The API is limited in that it can't use Vision or generate images, but I imagine that those are just "Tools" too that the assistant has access to.