Y
Hacker News
new
|
ask
|
show
|
jobs
by
causal
361 days ago
Do you have a package for calling LLM services we can use? This service is neat, but I don't need another LLM IDE built in Elixir but I COULD really use a way to call LLMs from Elixir.
1 comments
chrismccord
361 days ago
Req.post to /chat/completions, streaming the tokens through a parser and doing regular elixir messages. It's really not more complicated than that :)
link
throwawaymaths
361 days ago
even less complicated, just set stream: false in your json :)
link