[jcgrillo]

Ok, if I notice other devs suddenly getting 5x as productive I'll give it a try, but so far no such effect has been demonstrated. It seems like a pretty straightforward research question, and you'd think if there was any demonstrable effect the companies selling these things would use such research to market their products. So where is it?

[fragmede]

There's a dead body lying there but you won't believe they're actually dead until someone creates a video reenactment of the killer stabbing them and shoves that video in your face?

Speaking of videos, https://youtu.be/opi1s_5Dm-c is probably below your level and it's kinda long.

[jcgrillo]

I don't get it. What is the dead body thing about?

[fragmede]

There are people building things and making money using these new techniques, but because they haven't stopped to produce research studies and white papers about their work, you want to presume it doesn't exist.

[jcgrillo]

Yes, without evidence there's no effect. It's telling that nowhere on cursor.ai's website do they appear to claim using their tool will actually make you, or crucially your team, more efficient.

[fragmede]

evidencthe absence of evidence doesn't mean there's no effect

[jcgrillo]

There is no trustworthy evidence that I'm aware of to support the claim that "using an LLM IDE makes developers 5x more effective". Do you disagree? Testimonials don't cut it, because individuals are prone to hysteria, delusions, and just making stuff up.

All I'm asking for is a few trustworthy case studies showing unambiguously that it's worth my time and money to pay attention to this genai stuff. That shouldn't be hard for a trillion dollar industry, right? Like show me this isn't just hysterical hype. Don't tell me, show me.