|
|
|
|
|
|
by visarga
2353 days ago
|
|
|
> Do you have an example of a library or snippet that demonstrates this? All NLP neural nets (based on LSTM or Transformer) do this. It's their main function - to create contextual representations of the input tokens. The word 'position' in the 728 dimensional space is an embedding and it can be compared with other words by dot product. There are libraries that can do dot product ranking fast (such as annoy). |
|
|