|
|
|
|
|
by dkarras
784 days ago
|
|
transformers / attention is very robust against typos as they take the entire context into account just like we do. launch any free LLM and ask them questions with typos that you would notice and auto-correct and you'll see that the models just don't care and understand them. actually they are so resilient that they understand very garbled text without breaking a sweat. |
|
I am constantly surprised by how well it copes with my typos, grammatical errors and generally poor spelling.