[dcre]

I think we have quite good reason to expect more. As I said, we already know (caveat with your level of irrational skepticism toward the overwhelming evidence) that the best existing models are better than the ones publicly available.

[simonw]

For what it's worth, at PyCon US this year I ran into a few people with access to Claude Mythos and they confirmed that it's notably better at writing code than public Claude Opus 4.7.

[dcre]

And there's a whole lot more evidence than that!

[palata]

> caveat with your level of irrational skepticism toward the overwhelming evidence

If you can talk about my irrational skepticism (because I said that "we don't know the future", I suppose?), can I talk about your total lack of common sense?

Because the economy has been growing in the last decades does not mean that it will keep growing for the next decades. Because LLMs have been improving in the last few years does not mean that they will keep improving in the next few years. Maybe, maybe not, your guess is as good as mine. If you know the future, put your money where you mouth is and invest everything you own in LLM companies.

Your overwhelming evidence is about the past: it has been improving in the past.

[dcre]

I must have thought I wrote something that I didn't actually write in the previous comment — I can't figure out what "as I said" is supposed to be about.

In any case, maybe I was too subtle. I was talking about Mythos, a model that continues the trend, but which is not available to the public yet. The "overwhelming evidence" is the testimony of the people who have used it. The irrational skepticism was people who don't believe that testimony. In other words, we do know the future, because we know that model and others like it will come out soon.

[palata]

Mythos is already here, you cannot use it for predictions just because you don't have access to it...

I just have an issue with all the people saying "I predicted this 10 years ago" (implying something like "you should listen to me, I make good predictions") while conveniently forgetting all the things they predicted wrongly, or the survivorship bias.

We don't know that AIs will continue improving at the pace they have, because we don't know the future. Some people will guess right, some won't. And those who guess right will be tempted to believe that they guessed right because they are more clever. All we can say is that it is possible that it improves, and it is possible that is stops improving.