A quick google search reveals GPT-Neo and GPT-J as being open source. But haven't yet tried them, so can't vouch if they're as good.