Hacker News new | ask | show | jobs
by queezey 3048 days ago
Very cool.

I noticed that it's mangling some of my URLs, though.

`/!0ead1aEq` is getting turned into `/%210ead1aEq` (the exclamation point is getting percent-encoded), which leads to a bunch of spurious 404 errors.

https://tools.ietf.org/html/rfc3986#section-3.3
2 comments
seanwilson 3048 days ago
Ah, thanks a good bug report! I'll get this fixed.
link
seanwilson 3045 days ago
Hmm, so when crawling, URLs are normalised and the URL library I'm using is normalising the "!" to "%21". Could you send me a working URL to test on? My email is sw@seanw.org if you want to use that.
link