|
|
|
|
|
by blagie
1202 days ago
|
|
<-- For all of these projects, this is the major question. I just wish it was standard form to include: "This project requires __GB of RAM, and, if running on GPU, __GB of VRAM for the _B parameter model. It will generate output at __ tokens per second on a ___ CPU, and __ tokens per second on a ___ GPU." It's obnoxious as heck as it is right now, since a bunch of things fit, a bunch don't, and there's a lot of overhead to find out. |
|