|
|
|
|
|
by Maxsob86
1412 days ago
|
|
Hi, thanks for the feedback. Yes, the API is able to handle accents and punctuation in utf-8. I have not made proofs using latin1 encoding but I will check how it's handling it (thanks for the hint). The example was taken from a knowledge base (utterances and examples to tell our AI what to recognize things inside the chatbot) of one of the users. They feed the AI algorithm with all sorts of examples, some with good punctuation and orthography but the majority have spelling errors, which are also very common in the users' interactions with the bot, and we get good recognition results with and without the tilde. We are also handling spelling errors and enhancing this since it seems (surprisingly) to be a big issue for a lot of standard NLP engines. Regards |
|