Y
Hacker News
new
|
ask
|
show
|
jobs
by
scriptsmith
596 days ago
Yes, I've used the v3.2 3B-Instruct model in a Slack app. Specifically using vLLM, with a template:
https://github.com/vllm-project/vllm/blob/main/examples/tool...
Works as expected if you provide a few system prompts with context.