We ran the exact same Amazon shopping task with 9 leading AI models in the browser. Same site, same steps, same environment. Only the model changed. A few things stood out:
1. Fastest model: 70 seconds
2. Slowest model: 340 seconds
3. Cost range: $0.03 to $1.04
4. Only 2 of 9 models picked the right product!
1. Fastest model: 70 seconds 2. Slowest model: 340 seconds 3. Cost range: $0.03 to $1.04 4. Only 2 of 9 models picked the right product!