[hparadiz]

I can use a local model to build a restaurant website. The model generates code fast enough that even my 10 year old server can generate all the code needed in about an hour. It will use about 50 cents of electricity and be better than 90% of the restaurant websites out there.

[camillomiller]

How is that relevant? The convenience for restaurants owners is how easy, cheap, non-technical, and fast the process is. You proceeded to make a point that does not match any of these four prerequisites

[dd8601fn]

I’m curious what you’re using for that (if you’re inclined to share).

[hparadiz]

I saw that blog post about running local models on a Xeon based server so I benchmarked a bunch of local models on it. The server is dual Xeons with 256 GB of DDR4 and I found it capable of running some things locally. It's slow but still faster than coding things manually. Also that was just an example. Even my 6 year old 6900XT is faster.