Hacker News new | ask | show | jobs
by cruffle_duffle 596 days ago
How is doing it server side a different challenge than something like google collab or any of those Jupyter notebook type services?
2 comments

Shared resources and multitenancy are how you get efficiency and density. Those are at direct odds with strict security boundaries. IME you need hardware supported virtualization for consistent security boundary of arbitrary compute. Linux namespaces (“containers”) and language runtime isolation are not it for critical workloads, see some of the early aws nitro/firecracker works for more details. I _assume_ the cases you mentioned may be more constrained, or actually backed by VM partitions per customer.
Google Collab are all individual VMs. It seems Anthropic doesn’t want to be in the “host a VM for every single user” business.