The worry comes from what you can do. If you did not want this power you would not ask for the information and explicitly say you have power over it.