I believe you can co-write music too. My original plan for expanding the project was to train on MIDI-karaoke files, and folks from OpenAI recenlty proved that actually works for MIDI with no text: https://openai.com/blog/musenet/