[domenicrosati]

I am all for independent discovery but the author should know in the language modeling community we have known this for years [1]. The authors of DALLE are well aware of it. We have many concerted efforts to try to solve for it. Heck even have whole conferences (semeval, *sem) dedicated to a host of known issues beyond negation (try adding quantification (every/some), or quantity (1,2,3, one,few,many) to the prompts) that we just know both theoretically and empirically dont work with our current embeddings (see [2] for a great overview sorry is paywalled).

[1] https://aclanthology.org/2020.acl-main.698/ [2] https://www.annualreviews.org/doi/pdf/10.1146/annurev-lingui...