Hacker News new | ask | show | jobs
by pdpi 2843 days ago
Scribe is the Facebook-internal Kafka equivalent. LogDevice is the storage layer used by Scribe.

Scribe isn’t the only place where LogDevice is used though — Facebook has documented using it for TAO as well (as part of the secondary indices)

1 comments

I don't believe Scribe and Kafka are equivalent. Isn't Scribe at-most-once?

Unless we're talking about two different projects named Scribe, which is certainly possible.

As lclarkmichalek said, there’s more than one way to skin a cat.

At any rate, I used “equivalent” here to mean that, while different trade-offs have been made, it has the sort of users building the same sort of applications on the same sort of abstractions — it plays the same role, for all intents and purposes.

Scribe doesn't really make decisions about that, it doesn't store checkpoints for readers. Readers are commonly more-than-once.
> Scribe doesn't really make decisions about that

It kind of does, on the write pipeline. Tailers vary, but scribed controls the semantics of how your message gets delivered to LogDevice.