Free server-size model access for apps with <2M downloads, getting the same privacy guarantees. Hopefully they scale this up to all apps in time (I assume hardware/cost constrained, but larger devs would pay).
My guess based on the Apple Intelligence Extensions mentions is that they will not scale that up anytime soon, but they will allow developers to integrate with other providers that the user has an account with.