[azinman2]

What’s the “assistant: {" trick? You just end your prompt with that?

[simonw]

Mistral supports prefixes: https://docs.mistral.ai/guides/prefix/

[azinman2]

That’s cool. However it only shows a few odd. I’d imagine the model needs to explicitly support this (be trained with it). None are about json… do you use that trick with json?

[simonw]

I use it to get JSON pretty often. See also: https://twitter.com/simonw/status/1885091289554968975