Hacker News new | ask | show | jobs
Developing a Computer Use Model (anthropic.com)
3 points by marsh_mellow 600 days ago
1 comments

> On one evaluation created to test developers’ attempts to have models use computers, OSWorld, Claude currently gets 14.9%. That’s nowhere near human-level skill (which is generally 70-75%), but it’s far higher than the 7.7% obtained by the next-best AI model in the same category.

Here, "next-best AI model in the same category" referes to which model.