Others' actions can limit your freedom. When I am forced to do something, I am made less free. Being forced to inhale secondhand cigarette smoke is an example.
>Freedom is the right to act, not immunity from the effects of others' actions.
What about the freedom to keep slaves? The slaves are "free" to run away, they're just not "immune" from the actions of the slave keeper if they get caught.
This is why the term freedom is almost useless. People inevitably mean "the set of freedoms I care about", which will always come at the expense of other freedoms.