Hacker News new | ask | show | jobs
by visox 1996 days ago
nice, what is actually needed to crawl onion sites ?

i am not a go dev, would try it with scala/java
1 comments
creekorful 1996 days ago
Just a tor proxy (socks) instance, and a HTTP client configured to use the proxy. Other than that nothing more than what a web crawler should have.
link
visox 1996 days ago
cool i look into that some time.
link