I mean you have the freedom to shit in your hand and eat it, doesn't make it a good idea, or imply that the people around you should be pleased at your choices.
If you're a pregnant woman in the US South that wants to get an abortion, should you not get that abortion if the people around you wouldn't be pleased?
Or should you be free to do whatever the fuck you want, because it's your choice?
I didn't try make the argument that people should blindly do what those around them want them to do either, where did you get that? I'm just pointing out that "caring less what others think" isn't inherently virtuous. You turned it into this freedom brain shit, but like obviously of course you are free to do whatever, and people are free to feel how they feel about it. Whether you're willing to bear those consequences is part of the decisions-making that forms your freedom to act, how could it be otherwise.