Hacker News new | ask | show | jobs
by bigstrat2003 28 days ago
LLMs absolutely do not exceed the abilities of junior devs. They don't even meet that bar, let alone exceed it. Junior devs are capable of getting syntax right without someone going "hey you messed that up". LLMs are not. Junior devs get basic logic right. LLMs do not.

Comparing an LLM to a senior developer is an absolute joke.

3 comments

1. Which LLM are you using that is “not capable of getting syntax right”?

2. Are you referring to without having a compiler or LSP check it? Although even then, the recent LLMs I've used still frequently get syntax right, whereas I'd expect juniors are often using a LSP or compiler to catch mistakes while writing code?

What model are you using? Llama 3.1 8b? This has not been true for years.
Well, in another comment he said that LLMs haven't improved in 3 years. So this puts him at Llama 1 7B.
they 100% exceed even medior developers.

who cares about syntax? who cares about iteration? what I care about are _results_, which they can produce at the end. do you check your human colleagues how many iterations they do before committing/showing their work to anybody? no. why should you set such a bar then for your LLM?