|
|
|
|
|
by piazz
1 day ago
|
|
Great writeup. The excessive function thing has always driven me crazy; I guard against this explicitly in Claude.md. I have found that models are generally poor at managing refactors / complexity while also implementing new features. But I’ve had some success with a semi-lights-off approach where you decompose it and prompt the model adversarially in a second pass to look for new rough edges and areas of complexity or refactors that might simplify the codebase. So I’d be very curious to see this benchmark but with something like a periodic “refactor turn” interleaved in. Also eager to see Fable benchmarked; anecdotally that was the only model whose code I felt I could actually trust to not review closely. |
|