[nickpsecurity]

re llm I linked

It's designed for drafting legal documents for lawyers. It's pretrained on a ton of court documents.

re why generalists are better

Much knowledge we have builds on prior knowledge. The prior knowledge is often reused across domains. Analogous reasoning, important in creativity, also connects facts or heuristics across different domains. Also, just being better at English.

If training a coding LLM, it needs to understand English, any concepts you type in, intrinsic knowledge about your problems, general heuristics for problem solving, and code with has comments and issues. The comments and issues might contain or need any of the above.

That's why I believe generalist LLM's further trained on code work better than LLM's trained only on code.