Can Meta's 'MusicGen' AI Outshine ChatGPT in Melody Creation?

  • Meta's 'MusicGen' AI: Melody Creation Beyond ChatGPT. Explore the Power of Meta's Open-Source Music Generator.Meta successfully joins the AI Music generation race with Open-Source tools.
  • What are the first results we got?
Meta's 'MusicGen' AI: Open-Source Melody Creation Tool

In a bid to keep up with Google, Meta has unveiled its own AI-powered music generator called MusicGen. What sets MusicGen apart is that Meta has made it open-source, unlike its competitor. This move allows developers and enthusiasts to access and utilize the tool.

MusicGen takes a text description, such as "An '80s driving pop song with heavy drums and synth pads in the background," and converts it into approximately 12 seconds of audio. Additionally, it offers the option to be guided by reference audio, incorporating both the provided description and melody.

To develop MusicGen, Meta trained it on an extensive dataset of 20,000 hours of music. This included 10,000 licensed music tracks, which were deemed of high quality, as well as 390,000 instrument-only tracks sourced from Shutterstock and Pond5, prominent stock media libraries. While Meta has not shared the code used for training the model, pre-trained models are available for anyone with compatible hardware, primarily a GPU with around 16GB of memory.

Might this signify the rise of AI surpassing musicians in their craft? Well, it appears that MusicGen's prowess still falls behind the irreplaceable essence of human musicians. The generated songs are moderately melodic, particularly for basic prompts such as "ambient chiptunes music." They are on par, if not slightly superior, to the results from Google's AI music generator, MusicLM. However, they lack the finesse necessary to win accolades.

For instance, when prompted to generate "jazzy elevator music," MusicGen produced the following sample:

MusicGen jazzy elevator music

In comparison, here is MusicLM's rendition:

In a more complex test, MusicGen was challenged with the prompt "Lo-fi slow BPM electro chill with organic samples." Surprisingly, MusicGen outperformed MusicLM in terms of musical coherence, delivering a track that could easily find a place on Lofi Girl. Here is MusicGen's sample:

MusicGen's Lo-fi slow BPM electro chill with organic samples

And this is MusicLM's attempt:

To diversify the assessment, it was attempted to generate a piano composition in the style of George Gershwin using both tools. However, Google's MusicLM has implemented a filter that blocks prompts mentioning specific artists, aiming to address copyright concerns. MusicGen, on the other hand, lacks such restrictions. Regrettably, the outcome of the prompt "Background piano music in the style of Gershwin" was unsatisfactory:

Background piano music in the style of Gershwin

Although generative music has made significant strides, moral and lawful concerns still loom. MusicGen, like other AI systems, learns from existing music to replicate similar effects, which has raised issues among artists and users of generative AI. Homemade tracks utilizing generative AI have gone viral, often imitating authentic sounds. However, music labels have promptly flagged such instances to streaming services, citing intellectual property concerns. The implications surrounding copyright infringement by "deep fake" music remain ambiguous, awaiting clarification through ongoing lawsuits that address the rights of artists whose work is unknowingly and involuntarily used to train AI systems.

Meta, taking a different approach, has refrained from imposing usage restrictions on MusicGen. The company assures that all the music used for training MusicGen is covered by legal agreements with the rights holders, including a deal with Shutterstock.

The emergence of AI music generation technology has ushered in a new era, but its impact and legal implications are still being defined. As the technology evolves, artists, labels, and rights holders eagerly await guidance and clarity regarding the boundaries of generative AI in the music industry.

Nataliia Huivan
Nataliia Huivan
Professional author in IT Industry

Author of articles and news for Atlasiko Inc. I do my best to create qualified and useful content to help our website visitors to understand more about software development, modern IT tendencies and practices. Constant innovations in the IT field and communication with top specialists inspire me to seek knowledge and share it with others.

Share your thoughts in the comments below!

Have any ideas or suggestions about the article or website? Feel free to write it.

Any Questions?

Get in touch with us by simply filling up the form to start our fruitful cooperation right now.

Please check your email
Get a Free Estimate