More like "Are you sure? I'm worried that <opposite of thing interlocutor just said>." or "Sorry, I think it's actually <opposite>". Both in an apologetic tone. The word "respectfully" sounds like it's trying too hard: it's a bit overtly subordinate and ingratiating.