[reaperman]

This looks competitive against CLIP, and surprisingly great at VQA style prompts, but it doesn't seem like the paper supports comparing it to GPT-4. We don't see any tests for coding performance, math homework, legal document review, or any of the myriad other things that people use GPT-4 for on a daily basis.

[zshrc]

Besides homework, all of these things seem to be professional uses of GPT-4. If they’re trying to bake this into a consumer platform like Siri, I don’t see why they’d need to focus on those use cases. Besides MDM/Enterprise, which will be curious if they try and attack this market or just their army of consumer devices.

[fauigerzigerk]

They are going to have to focus on the use cases that most of their customers use LLMs for, regardless of whether it falls in the consumer or professional category or somewhere in between.

If all it does is improve Siri a bit without massively expanding the range of applications and APIs it will be a big disappointment.

I think what Apple presents in June will decide whether on-device AI will be seen as a viable alternative to cloud APIs.

[jwells89]

Many users of Siri would be thrilled if all this did was made it decent at understanding what’s being asked of it and gave it the ability to ask clarifying questions, especially if it does so staying fully local.

[thejazzman]

I'd love to turn my lights on and not have my garage door open or thermostat suddenly change to 90 and my furnace fire up.

It's a really low bar right now :D

[reaperman]

Good insight. My comment was based on the headline that says "...Competing with ChatGPT".