Probably no significant impact, and probably no significant difference between the two. It's angled so it largely doesn't touch the capsule (https://commons.wikimedia.org/wiki/File:Apollo_Pad_Abort_Tes...) and the capsule is made to keep the occupants safe through reentry, which reaches higher temperatures and lasts much longer than the second or two the pad abort rockets fire.
(It might even be less heat impact to the capsule than the Dragon-style rockets, as the hot spent rocket remains on the capsule; Apollo-style abort towers jettison.)
