Hacker News new | ask | show | jobs
by ytkimirti 4 hours ago
Hello HN,

This was a small project of mine after I've found out that I can simply the whole hackernews archive (~48GB) and play around with it.

You can compare terms just like in google trends and you can also see the exact posts & comments from that time.

I like that you can discover what went crazy in the timeline, they just come up as small burst of activity, it's quite fun to play around with it. https://hackernewstrends.com/?q=litecoin&q=dogecoin&q=solana...

I also have a seperate page for the "Who is Hiring?" posts, here is the distribution of programming languages over each monthly "Who is hiring?" post in HN ever. https://hackernewstrends.com/who-is-hiring

Any kind of feedback is welcome.
3 comments
omoikane 1 hour ago
> https://hackernewstrends.com/who-is-hiring

Currently it says "no job-post mentions in this window" for everything. Transient error?

link
jupr 2 hours ago
Honestly the HN archive is very valuable. If you had it all on a local db with everything indexed you basically end up with a offline search engine.

Where is this archive located you speak of?

link
jupr 56 minutes ago
found : https://huggingface.co/datasets/open-index/hacker-news
link
fragmede 2 hours ago
It's on firebase, per https://github.com/hackernews/api
link
cbeach 2 hours ago
This is excellent.

A minor suggestion - I'd like to be able to render the current graph taller (full height of my browser window).

Also some sentiment analysis on the "people" graphs would be very insightful (particularly for the likes of Edward Snowdon, Julian Assange, Elon Musk and Sam Altman). Perhaps colour the area under the graph red-orange-green based on the sentiment?

link
ytkimirti 2 hours ago
Thanks for the feedback, noted the full-screen request.

The sentiment analysis is very interesting, I can do that easily. Could be a new page as well. Did you see this anywhere else or just your idea?

link
cbeach 2 hours ago
Just my idea. I'm working on a side project https://newsavista.com/invite/ASAD68923E that aggregates news and tracks news trends and changing sentiment on the major stories. With cheap cloud LLMs (and "free" local LLMs) it turns out to be a trivial feature to build.
link