[wsgeorge]

I believe this has been extended to mean "on device", which is interesting. See Gerganov's article on Github [0]. I wrote about this here [1] where I made a contrast between the core and the edge. I think the term maps well to this meaning.

What I find more interesting is that in the classic "close network proximity", some parts of the world may not have benefited as much from that trend since the closest nodes of a global delivery network could be several countries away.

[0] https://github.com/ggerganov/llama.cpp/discussions/205

[1] https://medium.com/sort-of-like-a-tech-diary/consumer-ai-is-...

[TeMPOraL]

> I believe this has been extended to mean "on device", which is interesting.

I don't like the connotations this carries. This is almost openly talking about reaching all the way into peoples' hardware to run your software, for your benefit, on them, without their knowledge, consent or control...

[wsgeorge]

I see. Hadn't considered this. Yes, I see how that might be a concern.

What I think is important in this AI Spring is that we make it possible for people to run their own models on their own hardware too, without having to submit anything to a large, centralised model for inference.