|
|
|
|
|
by cornel_io
1588 days ago
|
|
Lexical homogenization is not the same as idea homogenization, and it does not surprise me that as time goes on the word choice in a given category of writing (esp an insular one like grant applications) would constrict. It also wouldn't surprise me a huge amount if the idea space was constricting, but just looking at the cosine distance is not enough to establish that. There probably are meaningful ways to exploit and analyze the representations inside language model transformers to better capture the idea-space geometry, but that's a big research project. |
|