[rsynnott]

> Recently I had an experience where the chatbot gave completely wrong subway instructions over and over again.

So, slightly offtipic, but, I just... don't understand why anyone would use it for this. This is a solved problem. The operator likely has a planner app. Google and Apple Maps have planners which support most systems. Transit and various other third party things have planners. I think even OpenStreetMap may even have one!

Quality can vary (I find that Google Maps in particular feels like the people who worked on the trip planner had never in fact used public transport; it's very prone to suggesting absurdly complex routes involving three or four transfers where "walk for ten minutes and no transfers" is viable), but this feels like something an LLM is likely to be _particularly bad at_, unless it just calls Google Maps or whatever, in which case why bother?