Then maybe the easy solution is to make sure anyone showing up late doesn't disrupt anything? That accommodates everyone, is flexible, and does not unfairly punish anyone.
Isn't it reasonable that we try to disrupt each other as much as possible as a default? It seems odd to force that responsibility onto another party. (ie it's weird to assume the professor is responsible for making sure another adult isn't disruptive)