|
|
|
|
|
|
by ninjin
4698 days ago
|
|
|
It is similar, but at least according to what Mikolov wrote as a response to reviewer comments regarding LDA/LSA/tf-idf [1], LDA does not preserve linguistic regularities such as king - man + woman ~ queen. I asked for additional clarification, but so far I haven't received a reply. A good intuition as to why these kinds of regularities could even exist was given by Chris Quirk as a blog comment [2]. Essentially, imagine that each word is approximately represented by the contexts it appears in, if so, swapping in and out the contexts of other words could indeed preserve some linguistic regularities. [1]: http://openreview.net/document/7b076554-87ba-4e1e-b7cc-2ac10... [2]: http://www.blogger.com/comment.g?blogID=19803222&postID=5373... |
|
|