[EamonnMR]

Kafka is a very nice communication channel. You can dump the results into a database and query it if you need a database.