The GPT-2 based Musenet music generator is already interesting but far from perfect. You can try it in the middle of this article:
https://openai.com/blog/musenet/
(you can even upload custom prompts in the advanced mode)
Would be interesting to see it with the updated GPT-3.
There is also AIVA with more production ready results: