It turns out to be so. If a reply is not a rebuttal, it is usually preceded with something like "To clarify, ..." or "I wanted to add, that ...". I just got confused without it.