It's extremely premature to be using this tech in critical real-world situations like this. This sort of thing makes me very nervous about using hospital services. Here's hoping that I don't have to be the next guinea pig.
But I was talking at a deeper level. I don't trust the use of this tech in things as critical as medical treatment. I think it's far too green for that.
That hospitals are beginning to incorporate it reduces my trust in hospitals.
I mean obviously it's broken UX and/or poor architecture overall. That's not an AI-creep problem.