I don't think it's easy at all without access to the training data.
I could ask about some information I find obscure in my native language but I can't be confident someone didn't write about it in English on e.g. reddit.
How exactly are you proposing he tests this without access to hundreds of thousands of dollars worth of compute? Toy models don't work for this kind of thing, small language models behave qualitatively differently from large ones.