[SOLAR_FIELDS]

I see. So this is like, I can have tabby be my LLM server with this limitation or I can just turn that feature off and point tabby at my self hosted LLM as any other OpenAI compatible endpoint?

[wsxiaoys]

Yes - however, the FIM model requires careful configuration to properly set the prompt template.