|
|
|
|
|
|
by srvmshr
988 days ago
|
|
|
Mostly a ton of JavaScript. As for the concepts explained visually, ICYMI there is a small footnote at the end of the article: > To generate the 50D word embeddings we used the GloVe 6B 50D pre-trained model and converted to Word2Vec format. To generate the 2D representation of word embeddings we used the BERT large language model and reduced dimensionality using UMAP. The self-attention values and the probability scores in the beam search section are conceptual. |
|
|