The medium of voice is very rich and capable when talking to a human, so this is something limited by the intelligence of the system you're interacting with.
Is it? I mean, some folks do great talking. Lots of them. Most are in narrative communication. If you get much beyond that, you jump to physical interesting quickly. Even telling is benefited with gestures. Consider how vague most spoken directions are. When you can augment with pointing, things are easier.