Hacker News new | ask | show | jobs
by posharma 1240 days ago
There’s an industry wide fad (like ChatGPT) and then there’s a hacker news wide fad which is SQLite :-). Not sure how it all started. Last few months (or my be even an year) there has been an unprecedented number of SQLite posts. What gives?
14 comments

I feel like it's just that it's one of the coolest pieces of software that every developer- web, backend, systems, or otherwise, has at least seen before. It runs in the browser, it runs on your phone, and unlike other databases (all of which are also very cool) it is completely within the domain of even a single inexperienced developer. It's just a little file on disk, just a library for accessing it, there's no magic! Especially if you're used to taking a database for granted it's just an extremely cool thing to think about.
The brilliance of SQLite is the brilliance of interfaces.

Value (in the abstract, not just $ sense) accrued around SQL.

At some point, so much value accrued that people were using it for things it wasn't designed to do.

SQLite provided a solution for "people who want to use a database, but don't look like traditional database operators." Turns out there's a lot of those.

That this large userbase existed was a brilliant observation, combined with brilliant execution in shepherding and evolving SQLite since.

And none of the above would've been possible if the SQL interface hadn't been standardized and adopted over the last few decades*.

* Turns out, SQL's 50th anniversary will be 2024

I think most programmers would like to be remembered for having written some really cool, useful piece of software - ideally by themselves or with a small team of people, where they have creative control over the requirements and design.

SQLite (and it's founder, Richard Hipp) are an inspirational example of such success.

Not just useful piece of software, but useful piece of software that actually gets widely used. Better yet, the one that has staying power, so it's not just a brief stint in the limelight.

Which, of course, is very much the case with SQLite. It shows that a small team with a vision and an emphasis on quality can make a product that becomes pervasive in the industry for decades.

Calling SQLite a fad is like calling Linux a fad.
He doesn’t mean using it. He means posting about SQLite on HN. The story of SQLite, how it came to be developed, how it’s tested, how it really works under the hood, funky ways to use it on the server for storage (fly.io, Cloudflare do this). All of these have become more common in the last year.
Yeah, my impression is that SQLite stories have been very common for many years on HN.

EDIT: did some counting, certainly a huge increase.

Threads with "sqlite" in the title:

2022: 346

2019: 142

Stories about technologies that people actually use are better than the usual PR fluff pieces about web-doo-dads that you need to pay-per-query.
Haha yeah I feel like SQLite is a very _told_ story on HN. Great story and tech for real, inspirational but also very trendy right now!
Yeah, exactly. May be I should’ve used the word trendy as some ppl take offense to the word fad for SQLite.
It might be more than a year actually. I'm pretty sure it was trendy 1.5 years ago. Remember I read a really cool blog post around then where someone used range requests to query SQLite statically. It used WASM + SQLite and hyped hard here.
SQLite (like curl and libcurl) have been pervasive and awesome for a long time and you'd always find posts about both on HN since forever, because of their ubiquity.

SQLite has been appearing a lot more often on HN because of a different more recent fad: edge computing.

how is sqlite a fad? its used pretty much everywhere, is simple, and yet surprisingly scalable to some
SQLite is not a fad. It’s just that it never gained so much attention here before.
Google Trends [0] indicates that sqlite is about as popular as usual. There's been some recent growth in the last year, but that's after a bit of a dip. A regression of the time series would be fairly flat.

I suspect popularity here comes in waves through a Katamari Damacy effect. People start reading about a topic, and start posting, thus more people read, research, post, etc... until a saturation point, a cooling off period, and then a rebuild.

[0]: obviously not the same as whats happening on HN, I'd love to see someone pull these numbers from the HN API!

They were talking about it being a fad here on HN, in terms of submitted (and upvoted to FP) posts per week/month/year. It's always been a topic getting the incidental FP attention, but the number of times something relating to SQLite makes it to the front page here seems to have increased considerably in recent months.
I believe I acknowledged that.
I think as single computers get more and more power, and engineers work in these super slow, eventually consistent cloud infrastructures, there’s a visceral appeal of an architecture that can run on my laptop and also scale to a reasonable user base. The only limiting factor for most applications at this point that would prevent a single machine from serving them is having HA/DR. So a lot of effort is being made at the replication side of SQLite so it can be part of this new stack. I am seeing it emerge as a reaction to the crazy amount of microservices and distributed computing just to solve small problems that could fit on a machine. And the inability to work locally as well.
Last few months? I feel like SQLite has been popular on HN for at least the last 5 years (and the data seems to confirm this [1]). In which case, maybe it's not so much of a fad?

[1] https://hn.algolia.com/?q=sqlite

Just a theory: containerized backends gave developers much more freedom of choice to pick technologies that happen to work better with SQLite.

Go and Rust work great with SQLite because all the concurrency is mediated within a single application process.

During the PHP and Ruby years, SQLite did not work that well and still does not, because the different worker processes can't communicate and SQLite has an extremely poor-performing sleep loop around the write lock.

This gave it a low-performance reputation compared to MySQL and Postgres that it has struggled to shake off.

I doubt ChatGPT is a fad. Feels like the second coming of the gun and it will have an outsized impact.
The underlying tech anyway.
Sure.
For me, it is always the best place to start when I need a DB for personal projects. The serverless nature makes it very easy to use. It is easy to fall in love with the convience it provides, because lets you focus on the fun parts of your project.
SQLite has excited HN for years