[smarvin2]

It does work by running the LLM on the database server but you can configure the LLM to run on the GPU

[ekianjo]

if you are using your database extensively how do you scale up your GPU resources for korvus?