Environment Generation: https://github.com/openai/multi-agent-emergence-environments
Worldgen: https://github.com/openai/mujoco-worldgen
Is this what you were looking for?