[FeepingCreature]

"Similar" is an inherently semantic property.

[tsimionescu]

Would you say that something like string.GetSimilarity(string), which tells you by what number of characters two strings differ, is interpreting the text?

Basically what GPT-3 does is to find a string X of a particular length such that it maximizes concat(userInput, X).GetSimilarity(someStringInTrainingSet).

Edit: to be clear, I'm not suggesting it's looking up the training set at runtime, X.GetSimilarity(someStringInTrainingSet) is basically what got baked in during training.

[FeepingCreature]

That is not what GPT does.

[JonChesterfield]

Words with the same length are similar to one another but not well correlated semantically. E.g. bog vs dog.