Hacker News new | ask | show | jobs
by vasco 584 days ago
I think it mistook a typo that didn't add a space after a sentence.
1 comments

I think this is the relevant code:

    TLDS = "[a-z][a-z]+" 
https://github.com/arXiv/arxiv-base/blob/develop/arxiv/base/...

A more restrictive TLD list would have prevented this, but I certainly don't want to be the one to add new TLDs all the time, so I can see why the code looks like it does.

Mozilla has a list, https://publicsuffix.org/list/, relatively easy to update. I'm sure there is some Python wrapper library they could use.