The problem with IngressRoute is that Helm charts are mostly using Ingress. Luckily, traefik have solved this through the use of annotations, which allows me to avoid using IngressRoute entirely.
Ah that's clever, I avoided it because it's a same-but-different technology and I try to avoid leaving the defaults. Just ingress wasn't so bad that was worth it. That is a good solution though.