“Can you put a banjo in a dubstep drop?”: Jacob Collier teams up with Google to launch AI-powered music creation tool MusicFX DJ
"You craft this real-time sonic putty that’s endlessly surprising, and essentially seeks to alchemize or forge connections between things that would otherwise be unlikely"
Earlier this year, Google Labs launched MusicFX DJ, an AI-powered music generator that produces evolving and layered musical compositions based on text prompts.
Since then, the team behind MusicFX DJ has been busy developing the tool in partnership with Grammy-winning musical polymath Jacob Collier, and today they’ve unveiled an updated version that considerably expands what you can do with the platform, while making it more intuitive and user-friendly.
Like its earlier version, MusicFX DJ lets you stack multiple text prompts together to create music based on your instructions. Simply type in the instrument, genre or vibe that you want to hear, and MusicFX will instantly generate sounds in response, blending them into the music in real time - a bit like you’re giving requests to a virtual, AI-powered DJ.
"For the last year or so I’ve been advising the Google team in their building of something rather thrilling," Collier said in an Instagram post. "It’s called MusicFX DJ – a sort of master-amalgamator of sonic elements. With it, you can shape music and sound in real-time using a wide range of prompts: instruments and genres, but also emotions, abstract images, and even made up words — to create a non-linear, weird, continuously evolving tapestry of sound."
MusicFX DJ’s interface lets you adjust the influence of each prompt on the overall composition or mute individual layers. In the latest version, you’re able to specify BPM and key to shape its tempo and tonality, mute drums, bass and other instruments, and even dial up or down the density and brightness of the music. Once you’ve landed on a result that you’re happy with, you can share the results or download a minute-long audio clip.
The results are a mixed bag. As was the case with MusicLM, an earlier version of MusicFX, much of its output sounds a little confused, and the quality is decidedly lo-fi - it's miles behind tools like Suno and Udio. It is, however, a lot of fun to play around with, and could be an interesting way to create musical ideas that can be fleshed out elsewhere, or generate royalty-free samples to use in your own tracks.
In a video published on Google's YouTube channel, the artist compares working with MusicFX DJ to improvising on a traditional instrument. “The joy of improvisation is I’m also in the audience,” he says. “I’m also watching what’s coming out. I can make choices based on what happens and what’s inspiring me at any given time. It’s trusting the first thought that comes into your mind.
Get the MusicRadar Newsletter
Want all the hottest music and gear news, reviews, deals, features and more, direct to your inbox? Sign up here.
“It’s a similar process when I’m prompting something into existence [with MusicFX]. It’s a continuous form that’s consistently creating things you’ve never experienced before. It’s an amazing premise. What am I dreaming up today?
“You craft this real-time sonic putty that’s endlessly surprising, and essentially seeks to alchemize or forge connections between things that would otherwise be unlikely… can you put a banjo in a dubstep drop?”
Visit Google's AI Test Kitchen to test out MusicFX DJ or watch Collier make a song with it below.
I'm MusicRadar's Tech Editor, working across everything from product news and gear-focused features to artist interviews and tech tutorials. I love electronic music and I'm perpetually fascinated by the tools we use to make it. When I'm not behind my laptop keyboard, you'll probably find me behind a MIDI keyboard, carefully crafting the beginnings of another project that I'll ultimately abandon to the creative graveyard that is my overstuffed hard drive.