Hacker News new | ask | show | jobs
by lwthiker 1409 days ago
curl-impersonate[1] is a curl fork that I maintain and which lets you fetch sites while impersonating a browser. Unfortunately, the practice of TLS and HTTP fingerprinting of web clients has become extremely common in the past ~1 year, which means a regular curl request will often return some JS challenge and not the real content. curl-impersonate helps with that.

[1] https://github.com/lwthiker/curl-impersonate

1 comments

Oh wow, thank you! I had no idea something like this existed. I was manually compiling against BoringSSL.