[N_Lens]

It's an interesting concept but the timing is probably too early. If more people had reliable low latency gigabit or ideally 10gbit throughput, then it might start to approach feasibility. There's other blockers too, but that springs to mind immediately.

It's cool to imagine a planet wide neural network interconnected with fiber - the nervous system of a planetary intelligence. But perhaps mushrooms do that already (Alpha Centauri ever relevant).

[woctordho]

Relevant: Why Switzerland has 25 Gbit internet and America doesn't https://news.ycombinator.com/item?id=47652400

[AlecSchueler]

The discussion points out, though, that many places in the US do have those speeds, while Switzerland also has places with much slower speeds.

[N_Lens]

I would say affordable 25gbit symmetric for residential is vanishingly rare in the US.

[c7b]

Not a neural network though ;) https://biologyinsights.com/do-fungi-have-a-nervous-system-t...

[hahahaa]

Too early too in that later (hopefully) each node can serve a full model so it is then a simpler share tit for tat of complete models.

[behnamoh]

Too early? the project has been going for years now...

[fwip]

What? LLMs are perhaps the least bandwidth-constrained thing you can do over the network.

If you run a local model at a good pace, you're emitting tokens at, what, 60 tokens/sec? That's, very roughly, 300 bytes/sec. You can get that speed with dialup from the 80's! And when it takes a half second just to ingest the input tokens (to get to the part where you start generating the reply), you're not gonna care about even a crazy 250ms latency.

Unless you think that the model should be downloaded on-the-fly in response to a user request, there's zero reason for an LLM to need any sort of fast connection.

[qmmmur]

A planetwide hallucination – sounds awful.