[rangerelf]

llama-server from the llama.cpp package has a local web interface.

[steveharing1]

yes. I've used it a lot. its very simple and good