They have released OpenELM.
https://machinelearning.apple.com/research/openelm
https://huggingface.co/apple/OpenELM