[mratsim]

Apple Metal does this though.

[liuliu]

Only recently. mmap file and directly use in Metal kernels is actually not supported until iOS 16 / macOS 13. Also, there are limited optimization opportunities around that and the recommended way seems still to use the specific Metal APIs to stream load assets from disk.

[capableweb]

Although Apple holds a <10% of total market share when it comes to computers, so not sure how helpful it is.

[Me1000]

Well Nvidia holds like 90% of the GPU marketshare, so any reply mentioning a competitor would have this property.

[pjmlp]

You missed the polyglot description regarding which workloads CUDA supports.