Y
Hacker News
new
|
ask
|
show
|
jobs
by
gclawes
362 days ago
Is this doing local inference? If so, what inference engine is it using?
2 comments
demosthanos
362 days ago
No, it's a thin wrapper around an API, probably OpenRouter or similar:
https://github.com/ccbikai/ssh-ai-chat/blob/master/src/ai/in...
link
ccbikai
361 days ago
Currently using the OpenAI API to access multiple models. You can use ollama to access local inference models
link
https://github.com/ccbikai/ssh-ai-chat/blob/master/src/ai/in...