[alpaca128]

> even early models interpreted the word "crashed" differently in "I crashed my car" and "I crashed my computer"

That has nothing to do with semantical understanding beyond word co-occurrence.

Those two phrases consistently appear in two completely different contexts with different meaning. That's how text embeddings can be created in an unsupervised way in the first place.

[esafak]

What do you mean? Semantics are determined by distribution. https://en.wikipedia.org/wiki/Distributional_semantics