|
|
|
|
|
by dofm
1 hour ago
|
|
Yeah. I also meant that this is an inflexion point with Apple Intelligence at the OS level. I suspect you cannot simply sprinkle AI functionality through an OS and manage the difference between unified and non-unified VRAM without noticeable tradeoffs. The marginal impact of adding some tiny amount of foundational model use to an existing app function is very different between the two. More so if you want to augment some existing functionality with model use, more so still if you were going to replace some functionality with model use (which I suspect is not yet happening). You could do it if you were not concerned about surfacing the RAM/VRAM implications to the user through seemingly arbitrary clashes (worse graphics performance or not being able to use the GPU to process some video because you have the larger foundation model loaded, or an AI function refusing to run because another task has booked a lot of VRAM). But Apple tend to be concerned about surfacing that sort of internal concept. Going forward with Apple Silicon alone means a bunch of questions like that simply don't come up. |
|