|
|
|
|
|
|
by lordnacho
1151 days ago
|
|
|
This is a pretty interesting example, as I think most of you will find that after playing 2048 for a bit, you discover a way to beat the game every time. I'm not sure I could code it up, but the heuristic is basically to keep the big numbers squashed against the same edge (eg the top) the whole game while using left-right-up movements to squash the smaller numbers into each other as opportunities arise. I don't think GPT could figure this out. My impression of it lately is that it's a sort of very advanced cargo cultist, maybe with a bit of superficial intelligence confined to the linguistic sphere. Asking it for a history essay gives you a grammatically perfect melange of likely terms that will do just fine for high school but possibly not for graduate level studies. I've never seen it do anything where I thought it had a parsimonious internal model of the problem. For instance I had it tell me about the quadratic equation, and the explanation was fine. When it came to plugging in numbers, it utterly failed, though the presentation was as if it understood it. If it had just a simple calculator inside it, this wouldn't be a problem. This game is also pretty simple, and for the same reason I don't think it can actually do it. |
|
|
That's - at the moment, AFAIU - a limitation of the tokenizers used to interface with LLMs. Basically, the model "calculates" bullshit because the input layer doesn't get correct inputs from the tokenizer.