I'm no expert in this field, but as I understand it they trained a new GPT model from scratch to play Othello. So the prompts were simply the transcript of moves that came before.
Yes, it's that. This model wasn't trained on natural language texts at all, so it can't be "prompted" with sentences like ChatGPT, etc. Lists of Othello moves is all it has seen.