[Mc91]

One thing I do is go to Leetcode, see the optimal big O time and space solutions, then give the LLM the Leetcode medium/hard problem, and limit it to the optimal big O time/space solution and suggest the method (bidirectional BFS). I ask for the solution in some fairly mainstream modern language (although not Javascript, Java or Python). I also say to do it as compact as possible. Sometimes I reiterate that.

It's just a function usually, but it does not always compile. I'd set this as a low bar for programming. We haven't even gotten into classes, architecture, badly-defined specifications and so on.

LLMs are useful for programming, but I'd want them to clear this low hurdle first.

[bongodongobob]

You're using a shitty model then or are lying. 4o one or two shotted the first 12 days of advent of code for me without anything other than the problem description.

[suddenlybananas]

How do we know you're not lying?

[bongodongobob]

Lots of people were doing it during Advent of code. There was a post here about it.

[apwell23]

can you unleash it on issues list on pytorch and see how many it can solve and submit patches?

[xigency]

Ahh yes. Because that other AI model is 100% perfect. Gee whiz.

Man the people working on these machines, selling them, and using them lack the very foundational knowledge of information theory.

Let alone understanding the humanities and politics. Subjectively speaking, humans will never be satisfied with any status quo. Ergo there is no closed-form solution to meeting human wants.

Now disrupting humans' needs, for profit, that is well understood.

Sam Altman continuing to stack billions after allegedly raping his sister.

[bongodongobob]

Well then live like someone would before the industrial revolution. The hypocrisy of saying shit like this on "The Internet" is always funny to me.

[xigency]

It's not ironic that technologists use very barebones and minimal websites with minimal automation. It's telling.

I already ditched my smartphone last month because it was 100% spam, scammers, and bots giving me notifications.

Apparently it's too much to ask to receive a well-informed and engaged society without violence and theft. So I don't take anyone at their word and even less so would trust automated data mining, tracking and profiling that seeks to guide my decision making.

Buy me a drink first SV before you crawl that far up my ass.