Never. I also consider it extremely rude when people I'm dining with do this. It's even more irritating than those horrible table kiosks.
Fortunately, at least with my friends, that's not a thing that really happens much. Phones stay in pockets where they belong, generally speaking.