[andyjohnson0]

The Guardian is reporting [1] that Q* "was able to solve basic maths problems it had not seen before" and cites a paywalled article on The Information [2]. They also say "the pace of development behind the system had alarmed some safety researchers" and "The artificial intelligence model triggered such alarm with some OpenAI researchers that they wrote to the board of directors before Altman’s dismissal warning it could threaten humanity,"

Sounds like it might be something notable, perhaps related to Q-learning and A* search as others here have speciulated. How it represents a specific or general existential threat is less clear, to me at least.

[1] https://www.theguardian.com/business/2023/nov/23/openai-was-...

[2] https://www.theinformation.com/articles/openai-made-an-ai-br...

[casualrandomcom]

It never occurred to me that "being able to solve basic math problems I had not seen before", implied that I "could threaten humanity". Wow!

[NicoJuicy]

> was able to solve basic maths problems it had not seen before

That's the thing. ChatGPT is interesting, but if it can find more precise associations than "the second best token", that's worrysome for a lot of digital jobs and jobs that can be replaced by robots.