Hacker News new | ask | show | jobs
by jhorey 4407 days ago
Here's mine: Ferry is a tool to help developers create (virtual) clusters on their local machines using Docker. Ferry supports Hadoop, Cassandra, Spark, and GlusterFS/Open MPI.

GitHub: https://github.com/opencore/ferry

I'd love help with:

Examples using these big data stacks. Examples can consist of simple Dockerfiles.

YARN/Spark integration. Currently Spark runs in stand-alone mode, but I'd prefer it to run as a YARN service.

Ability to support customized backend stacks so that users can include packages, etc.

If you're interested, please file issues on GitHub or shoot me a message on Twitter (@open_core_io).