Hacker News new | ask | show | jobs
by Gormo 333 days ago
> There is no friction. It's trivial to write a program that can scrape a Gemini network.

It's not trivial at all. First, you have to want to do it, then you have to commit time and effort to doing it, then you have to maintain the solution you deploy specifically for Gemini in parallel to your web scraping architecture.

> If there is no one pulling data from Gemini servers yet, is not because it's difficult do it, but merely because it's still too small to be relevant.

Exactly. But it if was using web tech, all of the existing web scrapers could just be pointed at it with minimal effort. So using a separate, custom tech stack is what keeps the threshold of effort in front the threshold of desire.

And using a separate tech stack also creates intentional friction in terms of new user adoption, keeping it slow and maintaining the protocol's niche status. So this also helps keep that threshold of desire distant.

1 comments

> First, you have to want to do it, then you have to commit time and effort to doing it

Implementing a Gemini to HTTP gateway seems like a perfect type of weekend project for someone that wants to play with a new programming language. With that, any barrier that you think you have is gone. Crawlers will get to you no matter what.

> So using a separate, custom tech stack is what keeps the threshold of effort in front the threshold of desire.

You know what else you could do? Just run your web server on a non-standard port.

Seriously, the more you try to rationalize this as anything else other than hobby, the less sense it makes. Just go with "it's a hobby and I enjoy spending my time with it", and I promise I will get out of your hair.

I don't know what to tell you at this point other than 'eppur si muove' -- you're giving me a bunch of theoretical reasons as to why you think it shouldn't work, and yet Gemini has been around for years now: it is maintaining itself as a distinct niche; it is not full of spam, ads, or slop; its content isn't readily accessible from the web or turning up in major web search engines despite the fact that there already are multiple web gateways around; and it generally does fulfill the intentions of the people using it.

You're treating this like a hypothetical discussion, but we're talking about something that already exists and functions.

And I don't think the "hobby" distinction you're making is particularly relevant, because the whole point of it is again to function as a community of amateurs -- and it's doing that quite effectively.

> because the whole point of it is again to function as a community of amateurs

Looks like I will have to point to the top of the thread again.

If your solution only works for a niche and it can only exist because it is so small that it is only interesting for a handful of people, then it is not an actual solution to the modern web!

That's not up to you to say. If it solves the issues I have with the modern web, it is an actual solution for me. And if changing my browser or installing extensions does nothing to solve the issues I have with the modern web, then that's not even on the table.

A solution that works for a niche... works for that niche. It's not like your solution of switching your browser or installing extensions universally solves anything. I absolutely despise the user experience of Firefox (which you suggested elsewhere) and ads aren't even close to the top of the list of my issues with the modern web.

Once again, what annoys you may or may not annoy me and what annoys me may or may not annoy you.

We are definitely talking about different things.

I'm talking about systemic issues in the modern web. Surveillance Capitalism. The control of mass communication platforms in the hands of a few corporations. The "attention economy" which makes creators more interested in collecting eyeballs than being rewarded by the quality of their work. Cultural homogenization driven by "the algorithm".

This is a lot bigger than "annoyances", and we are not going to solve any of this by acting like it all can be ignored and that all we need is to seek refuge in some ascetic application.

Quoting you:

> Problem: you are looking for a way to get rid of the annoying issues of the modern www. What is the solution that solves this with the least amount of work?

Talk about shifting the goalposts! If the idea is to dismantle surveillance capitalism and the attention economy, sure, Gemini won't get us there. But neither will Firefox or browser extensions.

You're talking a major political, societal and cultural revolution here, and for that I don't think "least amount of work" is something to be aiming for.