Alternate interpretation: he has had overly solicitous people fret over why he's not eating breakfast, and would rather simply put the topic out of everyone's minds. He comes off as a solidly decent person in the rest of this letter; losing his composure at the mention of breakfast seems out of character.