When this happens, you can still reply by clicking the timestamp above the post. The reply button will also appear after a while, the system just wants you to slow down.
i wonder if 'slow' notifications might be a good sweet spot. instead of notifying you about a reply instantly it could send a summary of replies once or twice a day