[andreyk]

Fun fact, the original GPT-3 paper has a whole section on arithmetic as part of its evaluation - https://arxiv.org/abs/2005.14165

Btw as per another comment this is GPT-NeoX-20B,not GPT-3 ; somewhat important distinction