Your position sucks, dude. Everyone should get more, not less. So yes, non smokers should be getting 'smoke' breaks that they can use for a walk, for example. And everyone will be happier.
I agree with you as well, even if your position isn't a popular one.
My employer has a strict 9 to 5 attendance policy (which I disagree with for a number of reasons), but one thing that really bugs me about it is that it applies to days when the roads are hard to navigate due to winter weather. Even if there's a state of emergency and the roads are "closed", we're expected to be here because our customers are all around the country, and they didn't have a snow storm, so we need to be here to support them.
Employees with children tend to get leniency in terms of coming in late on days like that, typically because they had to arrange alternative care for their kids with schools closed. But I have no kids, so if I get stuck behind a snow plow and end up getting to the office at 9:05 I'm probably going to get a lecture on how being late is me being disrespectful to the boss and the company.