[sp332]

Llama.cpp has --n-gpu-layers that lets you set how much of the model to put on the GPU.