[icebraining]

If I booked a tour and the host drove me to a different place to stay, that's all I can do.

Unless you're staying in some remote place, absolutely not! You can and should find some other place to stay unless the whole situation is very well explained. In any major city in the world, there are hotels and motels which speak English and other languages. There are also local guides if you need help making yourself understood.

Just being helpless and allowing the host to take you wherever they want is not safe!