[lfsh]

As search engine LLMs are nice. But for code generation they are not. Everytime it generates code there are small bugs that I don't notice directly but will bite me later.

For example a peace of code with a foreach loop that uses the collection name inside the loop instead of the item name.

Or a very nice looking peace of code but with a method call that does not exist in the used library.

I think the weakness of AI/LMMs is that it outputs probabilities. If the code you request is very common than it will probably generate good code. But that's about it. It can not reason about code (it maybe can 'reason' about the probability of the generated answer).