|
|
|
|
|
|
by teleforce
315 days ago
|
|
|
>who is using iceberg with hundreds of concurrent committers, especially at the scale mentioned in the article (10k rows per second)? Using iceberg or any table format over object storage would be insane in that case You can achieve 100M database inserts per second with D4M and Accumulo more than a decade ago back in 2014, and object storage is not necessary for that exercise. Someone need to come up with lakehouse systems based on D4M, it's a long overdue. D4M is also based on sound mathematics not unlike the venerable SQL [2]. [1] Achieving 100M database inserts per second using Apache Accumulo and D4M (2017 - 46 comments): https://news.ycombinator.com/item?id=13465141 [2] Mathematics of Big Data: Spreadsheets, Databases, Matrices, and Graphs: https://mitpress.mit.edu/9780262038393/mathematics-of-big-da... |
|
|