Hacker News new | ask | show | jobs
by stymaar 4 days ago
Sure, but does llama-cpp support that?
1 comments

It does and this is how I did it.

But actually getting that grammar right as well as actually making it work with the correct Jinja template to correctly enable thinking mode and parse it out was a lot more work than I expected.