You realise there is significant variation in the size of people’s hands? I consider a 4 inch phone so small as to be nearly unusable. Apple’s approach of having differently size phones for different people is the right one.
Good thing he isn't asking Apple to make only 4 inch phones. The way it is now, the SE is 3 years old and isn't getting a successor, leaving those of us who like and want small phones behind.