Hacker News new | ask | show | jobs
by seeekr 1344 days ago
Note that this seems to be a relatively old project, first commits from 2015. The project seems active, but most of the work seems to have been done around its inception, with some significant activity from 2020 onwards. Speculation/interpretation: So this might be a project that was used internally by some company, but perhaps not any more, and they've decided to open-source it at some point (2017-2018?) because some folks were/are still excited about it and want to keep developing it.

This might explain some of the "why yet another RocksDB-based KV store?" line of questioning.

3 comments

> yet another RocksDB-based KV store

Aaah, there was a super informative talk about the different databases at Facebook, most of them built on RocksDB, with different trade offs. (And I can't find the video :((((( )

Anyway, it makes sense to have yet another it if serves a different purpose. Eg. for read-heavy workloads (caches, serving user feeds, whatever), or write-heavy (monitoring, storing that sweet sweet tracking juice that then gets read once or twice while building the recommendation models), small or large blobs, latency requirements, HA/consistency requirements, how complicated queries are going to be, does it support secondary indices or not, etc.

That video sounds interesting, if you do manage to find it.
Pegasus was open-sourced by Xiaomi, and is still used internally according to https://apachecon.com/acasia2022/sessions/ai-1125.html.

Source: https://www.zhihu.com/question/66719537/answer/245270169 (in Chinese)

Apache foundation is retirement home for projects so it checks out
I wouldn't say thats accurate. Theres many super successful and active apache projects still. To name a few:

Kafka, Cassandra, Zookeeper, Spark, Tomcat, Superset, Storm, Lucene,Log4j2, Hadoop, etc. The list goes on, but I would safely say that a majority of the world's systems run on Apache projects which are for the most part actively developed

And arguably the venerable Apache HTTP Server ยท https://httpd.apache.org/ :-)
Despite all the modern alternatives, I'd bet my life that a majority (>50%) of the web is still being served by httpd.
"modern" is often overrated.
Not sure about others but tools like Superset have plenty of better alternatives like Grafana and Metabase.

So when there are better alternatives, it's not too inaccurate.