|
|
|
|
|
|
by walrus01
1 day ago
|
|
|
Yeah, or close enough to 5GB for estimation purposes, for example a just spawned qwen 3.5 122B llama-server instance reports as: 0.07.015.888 I common_memory_breakdown_print: | - Host | 170038 = 162913 + 6740 + 384 | The 6740 is the cache size. |
|
|