It sounds like you're being expected to, so yes.

But the key is to adjust your stories so you overdeliver rather than underdeliver, since the metrics are arbitrary.

No. It’s an estimate of effort not time. The estimate could be wrong, other things could have been moved in, sick leave etc…

Maybe yes, maybe no.