Hacker News new | ask | show | jobs
Show HN: Toy example of a distributed Hadoop cluster spun up with Docker Compose (github.com)
4 points by waltherg 3213 days ago
1 comments

I have seen similar examples of pseudo-distributed Hadoop Docker images that baked all HDFS and YARN daemons into the same container at runtime.

With this toy example I set out to learn more about Hadoop clusters by untangling the various components and move them to isolated containers that communicate via a Docker bridge network.

Hope anyone finds this useful!

This is really cool, thanks for sharing!