Hacker News new | ask | show | jobs
by dangoodmanUT 949 days ago
You defintiely can use S3 for appending to a WAL (I've done it), they have read-after-write consistency
2 comments

You're doing it for large OLAP writes. But as soon as you do OLTP or small writes it will become very slow & expensive.

See warpstream as example https://news.ycombinator.com/item?id=37036291

How about using Kafka for the WAL? Anybody tried that?
LogDevice or apache bookeeper is better for distributed log.