[Jensson]

> I don't think test scores have anything to do with the hype. Most people don't even realize test scores exist.

They put the test scores front and center in the initial announcement with a huge image showing improvements on AP exams, it was the main thing people talked about during the announcement and the first thing anyone who read anything about gpt-4 sees.

I don't think many who are hyped about these things missed that.

https://openai.com/research/gpt-4

[GuB-42]

It is what they talk about during announcements because people like numbers. It looks more serious than "hey look, GPT-4 smart" with some example quotes that anyone knows are cherry picked. But the real hype comes from people trying for themselves.

I seriously don't remember hearing these test results being mentioned in any casual conversation, and I heard a lot of casual conversations about AI. The majority of these center around personal experiences ("I asked ChatGPT this and I got that..."), homework is another common topic. When we compare systems, we won't say "this one got a 72 and the other got a 94", but more like "I asked new system to give me a specific piece of code (or cocktail recipe, or anything) and the result is much better". Again, personal experience and anecdotes before scores.

Maybe people in the field hype themselves with score, but not the general public, and probably not the investors either, who will most likely look at the financial performance of the likes of OpenAI instead.

[bensecure]

If you followed the initial announcement, then you were presumably already hyped. The novel thing about chatgpt has been the mass amount of people who hadn't heard about generative AI in the past glomming onto the technology. Most of these people heard about it via word of mouth. They then tried it themselves and told people about it. They never even heard of tests, let alone based their perception on them.