Hacker News new | ask | show | jobs
by noperator 1 hour ago
Having some success while testing this model out as a replacement for GPT-5 nano in source code security review. Running on RTX 3090 (24 GB VRAM) via vLLM. It's not great on structured output (as noted in the model card) but I'm working around that in my harness.
1 comments

Can't you just force it to do structured output via constrained generation?