[sweisman]

Can you email me with more info? It is likely the distinctions you noted are from the source. There is a glossary maintained that keeps specific words or phrases consistent. But slightly different phrases can resolve in inconsistent ways.

The problem is not the AI, but rather a weakness in the design. In other words, a bug. Or a regression and we call them today. It is fixable.

[names_are_hard]

I think that I might not have been clear enough. Of course Rosh mesivta and exilarch differ in the source, but I don't think a human translator would choose to translate one title and not the other. In circles where people use the word exilarch I am almost 100% positive no one would say Rosh mesivta, and the kind of folks who use Rosh mesivta in conversation would say Reish Galusa, not exilarch.

I can't imagine that metivta and mesivta are not both transliterations of the word מתיבתא.

You need to identify the target audience and stick to their language. Are you translating for a general lay audience? An academic audience? Contemporary religious Jews? If the latter, is it a yeshivish audience or a wider group? How much familiarity with Hebrew is expected from the reader?