Y
Hacker News
new
|
ask
|
show
|
jobs
by
dangoodmanUT
949 days ago
You defintiely can use S3 for appending to a WAL (I've done it), they have read-after-write consistency
2 comments
ddorian43
949 days ago
You're doing it for large OLAP writes. But as soon as you do OLTP or small writes it will become very slow & expensive.
See warpstream as example
https://news.ycombinator.com/item?id=37036291
link
rowls66
949 days ago
How about using Kafka for the WAL? Anybody tried that?
link
ddorian43
949 days ago
LogDevice or apache bookeeper is better for distributed log.
link
See warpstream as example https://news.ycombinator.com/item?id=37036291