Hacker News new | ask | show | jobs
by Der_Einzige 424 days ago
This 100% tracks with my experience.

Also fun stuff many don't know - If you run a regular models chat template with a reasoning tuned model, it can go back to acting like the base model, with no "thinking" process.

"Reasoning" models are not any better than non reasoning models. It's a parlor trick, and benchmarks which claimed it wasn't are bad.

1 comments

> If you run a regular models chat template with a reasoning tuned model, it can go back to acting like the base model, with no "thinking" process.

Well, of course. They've been "fine-tuned" with specific chat templates. Remove those and the fine-tune doesn't take precedence anymore. That's expected behaviour I'd say.

> "Reasoning" models are not any better than non reasoning models. It's a parlor trick, and benchmarks which claimed it wasn't are bad.

All of them? Including the closed ones, never public? I highly doubt that.