|
|
|
|
|
by visarga
1521 days ago
|
|
Gut feeling based on playing with it. Here's an example: > Colorless green ideas sleep furiously,
and other grammatical nonsense by Noam Chomsky He was a man without a country,
A linguist without a language,
A mind without a thought,
A dream without a dreamer.
He was lost in a world of words,
A world where ideas slept furiously,
And grammar was a never-ending nightmare. But he persevered,
For he knew that language was the key to understanding the world.
And so he continued to study,
To learn all that he could,
In the hopes that one day,
He would find his way home. |
|
You should check out the post we're commenting on, it has graphs for this exact metric.
Spoiler: Google's model with 3x the parameters does pass average human in a couple categories, but not at all. I don't think GPT-3 does in any.
It's doubly puzzling to me because you have access and are asserting it feels like an average human to you. It's awesome and it does magical stuff, I use it daily both for code and prose. It also majorly screws up sometimes. It only at an average human level if we play word games with things like "well, the average human wouldn't know the Dart implementation of the 1D gaussian function. Therefore it's better than the average human."