[spupe]

I went and checked, it turns out for this version Eleuther-AI has in fact included math problems [1]. So my earlier comment is partly incorrect.

[1] http://eaidata.bmk.sh/data/GPT_NeoX_20B.pdf

[asah]

And isn't it trivial to generate lots of correct sample data ? :-)