Hacker News new | ask | show | jobs
Show HN: IPpy – Parallel testing of IP addresses and domains in python (github.com)
18 points by marlynm 3332 days ago
5 comments
storyinmemo 3332 days ago
My suggestion for learning: re-write this using futures. Here's a quick example of using similar parallelism to search structured json in gzip'd files: https://github.com/autocracy/snippets/blob/master/search_clo...
link
emj 3331 days ago
Basically xargs in python, and I love xargs.

There are some cool examples of places were xargs fails in the docs, this got me very excited I hope it works in 2.7. https://docs.python.org/3/library/concurrent.futures.html

link
d0mine 3331 days ago
There is futures module for Python 2.7 on PyPI.

In simple cases, you could use multiprocessing.Pool():

  results = pool.map(processfile, getpaths())
There is also ThreadPool. There are known issues with multiprocessing especially on Python 2.7 e.g., Ctrl+C handling.

Though you don't need threading to manage concurrent subprocesses or IO (Gevent, Twisted or curio if you use Python 3).

link
mkesper 3331 days ago
And alwyays use if __name__ == '__main__' if you want be able to test your code.
link
marlynm 3331 days ago
I'm learning. Thanks for letting me know. Will use that.
link
marlynm 3331 days ago
Thanks. Will learn and use.
link
inkvizitor 3331 days ago
Did something similar few years ago natively in Python using Gevent. I think that it could scan several hundreds of IP's per second.

https://github.com/inkvizitor/asyncping

link
jhoechtl 3332 days ago
Where Python warrants a HN post, Golang (Rust, others) calls it natural. Use the right "tool" to do the job?
link
res0nat0r 3332 days ago
checkout fping: https://fping.org/
link
formula_ninguna 3332 days ago
what's the use case of it?
link
purrcat259 3331 days ago
I would guess: checking if machines are online without rolling an overkill monitoring solution. More of a smoke test than a proper solution (ping does not ensure a service is up for example).
link
marlynm 3331 days ago
1) Finding other reachable hosts in a local network. 2) This can be slightly modified to get average latency for each host. This is not a replacement for health check.
link