Hacker News new | ask | show | jobs
by NwtnsMthd 52 days ago
Just curious, what's your setup like? How do the devs interact with the model?
1 comments

OpenWebUI with postgres and vllm for inference, searxng for websearch a few other mcp's for tools.