We know which bots are the best at Chess. You'd care which AI is the most accurate at diagnosing your medical condition. It's not a bad thing to keep track of which automated systems are the best at certain tasks.
Because in chess you can be sure that no AI was used (and even there, there are controversies, see the recent Niemann/Carlsen scandal). Since math is not usually done in public, under competition rules, no one will know ever again whether some result was really obtained by a human.