Adobe Shows Off Text-To-Audio Tool That Easily Makes Music In A (Heart)beat
By Mikelle Leow, 29 Feb 2024
Image generated on AI
Adobe is hitting high notes with generative artificial intelligence, and not just with the text-to-image Firefly. Its research team, in collaboration with researchers from the University of California, San Diego, has just introduced Project Music GenAI Control, tuning up to streamline audio and music creation.
“With Project Music GenAI Control, generative AI becomes your co-creator. It helps people craft music for their projects, whether they’re broadcasters, or podcasters, or anyone else who needs audio that’s just the right mood, tone, and length,” shares Nicholas Bryan, senior research scientist at Adobe Research and one of the maestros behind the technology.
Users can compose their sound masterpieces by inputting descriptions such as “powerful rock” or “happy dance,” and the AI takes the cue to generate all-new recordings based on those instructions. The tool also offers fine-tuned editing capabilities, allowing users to remix, reshape, and refine their audio creations with precision.
Bryan demonstrates the text-to-audio project with Adobe social content specialist Dominique Graves in a video, showcasing how a simple text command can transform the iconic Habanera melody from Carmen into catchy hip-hop beats.
A user-friendly interface means tempo, structure, and intensity adjustments are just a few clicks away, making music editing as easy as adjusting a photo filter.
“One of the exciting things about these new tools is that they aren’t just about generating audio—they’re taking it to the level of Photoshop by giving creatives the same kind of deep control to shape, tweak, and edit their audio. It’s a kind of pixel-level control for music,” Bryan elaborates.
Project Music GenAI Control aims to conduct a symphony of possibilities for content creators who often find themselves wrestling with the constraints of existing audio. By enabling users to generate and customize music directly within their workflow, it eliminates the need for cumbersome manual edits, presenting a seamless solution from creation to final cut.
[via Adobe, cover image generated on AI]