For the record there is a level you can pay for CBS All Access that turns off the ads (at least on original content, which is I assume the only reason anyone would sign up for it anyway). It costs more than the ad-full version, but that's basically what you're asking for, right?
But like sibling said, they are presumably still tracking you. I don't think consumers have really become aware enough of tracking for "no ads, no tracking" to be a viable thing yet.