[eschluntz]

Thanks! We all dogfood Claude every day to do our own work here, and solving our own pain points is more exciting to us than abstract benchmarks.

Getting things done require a lot of booksmarts, but also a lot of "street smarts" - knowing when to answer quickly, when to double back, etc

[jasonjmcghee]

Just want to say nice job and keep it up. Thrilled to start playing with 3.7.

In general, benchmarks seem to very misleading in my experience, and I still prefer sonnet 3.5 for _nearly_ every use case- except massive text tasks, which I use gemini 2.0 pro with the 2M token context window.

[jasonjmcghee]

An update: "code" is very good. Just did a ~4 hour task in about an hour. It cost $3 which is more than I usual spend in an hour, but very worth it.

[martinald]

I find the webdev arena tends to match my experience with models much more closely than other benchmarks: https://web.lmarena.ai/leaderboard. Excited to see how 3.7 performs!

[LouisSayers]

Could you tell us a bit about the coding tools you use and how you go about interacting with Claude?

[catherinewu]

We find that Claude is really good at test driven development, so we often ask Claude to write tests first and then ask Claude to iterate against the tests

[Kerrick]

Write tests (plural) first, as in write more than one failing test before making it pass?

[zarmin]

Time to look up TDD, my friend.

[DrammBA]

One of today's lucky 10,000. His mind is about to expand beyond imagination.

[DrammBA]

I wish I could delete my original comment now that I found out that Kerric wasn't a lucky 10,000, he's just an asshole...

[Kerrick]

Time to actually read Test-Driven Development By Example, my friend. Or if you can't stomach reading a whole book, read this: https://tidyfirst.substack.com/p/canon-tdd

TL;DR - If you're writing more than one failing test at a time, you are not doing Test-Driven Development.

[zarmin]

oh my god, your comment was just a setup for you to be pedantic? all discourse on the internet is worthless. i don't know why i keep engaging.