[agilob]

There are so many regulations and certifications to do that there are no chances anyone will have money and time to do all paperwork to host it on-perm. Because of these regulatory reasons most hospitals use so old systems that it surprises no one to see Windows XP with IE6 there. I had the pleasure myself of fixing a Material Angular bug that wasn't displaying form fields validation correctly in IE6 only 2 years ago, and that was for network of hospitals in Canada, US and Germany. Effort to allow them to use anything newer is too big and there are too many documents to review. It's simply cheaper to keep WinXP and IE6 running for as long as possible.

[v4dok]

I've read about yesterday someone running LLAMA in a single GPU. Maybe if you optimise the model enough, you can give it to them as a box.

[actionfromafar]

Off prem is also a rats nest of regulations.

[agilob]

Yes, but it's done once, on demand for each customer and service-wide certificates don't expire for a few years or releases, so the cost is lower.

[Spivak]

Yep, I worked at a med-tech company and one of our biggest-value adds was that we were HIPAA compliant and part of Direct Trust — 10k customers one certification.