Hacker News new | ask | show | jobs
by erichmond 3863 days ago
I'm always fascinated by the lack of discussion around distributed systems tooling on HN. Anyway! Congrats!
1 comments
mathnode 3863 days ago
The only other beast of similar nature that appears occasionally I can think of, is Onyx. Which seems pretty cool.

Anyway,Kafka Connect will provide what probably most people are looking for in Samza.

link
nehanarkhede 3863 days ago
That observation is correct. Currently, people misuse stream processing systems like Storm and Samza for data import/export. This is an overkill. Kafka Connect is focused on providing scalable and operational connectors to various systems using Kafka as the underlying transport mechanism.
link
zodvik 3863 days ago
<plug>

We have built a fairly robust system along the idea of Kafka Connect and it's open sourced at https://github.com/flipkart/aesop. Currently, it supports MySQL & Hbase as sources and MySQL, Hbase, ES, Kafka as destination.

link
erichmond 3863 days ago
Haha, funny you mention Onyx! We pipe data from kafka into storm :) Great combo!
link