Hacker News new | ask | show | jobs
by yawnxyz 569 days ago
I wonder how much time it takes to run this / what the script is / how resource intensive it is? Bsky is public right, so do you get rate limited? Do you scrape or use an official API? So many questions

Also, I feel like only recently there's been an influx of people who have actually interesting things to say so I'd love to see nextyear's dataset

2 comments

Not sure about bulk export but you can set up a full stream of all activity without even registering an account.
Blows my mind that they can send that much for free.
I was checking out the Python API today (the "firehouse" via "atproto" package) and got 5000 posts in 7.5 seconds.
I believe they are enabling(ed?) filters so you can control how much and what you actually get from the firehose