|
|
|
|
|
by riku_iki
1493 days ago
|
|
> My linguistics background really helps me think through a lot of these 'applied' NLP problems. There many benchmarks where LMs absolutely outperform mechanical linguistics solutions. Do you have success stories when there is significant outperforming solution in opposite direction? |
|
I meant that my linguistics background helps me understand & solve problems: studying linguistic field work has helped me design crowd labeling jobs, knowing about morphology helps me understand why BPE tokenizers work so well (and when they might not), knowing about syntax/dominant word order makes me think that multilingual Bert should probably do something more intelligent with positional embeddings, methods from psycholinguistics are useful for understanding entropy/surprisal wrt LM next-word probabilities... just a few examples but the list could go on.