Adobe is Testing a New AI Tool that turns Text into Music
Adobe has recently announced in a Press Release that the Adobe Research team is working on a new AI project -Project Music GenAI Control. Adobe’s audio tool will help the users generate music from the text prompts.
Nicholas Bryan, Senior Research Scientist at Adobe Research says that-” With Project Music GenAI Control, generative AI becomes your co-creator. It helps people craft music for their projects, whether they’re broadcasters, podcasters, or anyone else who needs audio that’s just the right mood, tone, and length,”.
Big tech giants are continuously working on AI projects to generate informative content from text and images. Adobe has added an innovative concert in the AI industry. Now users can make that content more attractive by adding some extra drama of music to it.
Also read – Tim Cook Says Apple Will ‘Break New Ground’ in GenAI this Year
Music Generation: Adobe’s Audio AI Tool
Over the last few years, Adobe has been working on many generative AI projects. Now the company has created an experimental tool to generate music. However, it somehow looks like other text-to-image or text-to-video AI models. But Google Music LLM and Meta’s open-source AudioCraft only allow the users to create audio with the text prompts. They don’t support editing features in the generated music. Adobe’s audio AI does support that.
“One of the exciting things about these new tools is that they aren’t just about generating audio—they’re taking it to the level of Photoshop by giving creatives the same kind of deep control to shape, tweak, and edit their audio. It’s a kind of pixel-level control for music,” explains Bryan.
Looking into the details, adobe has mentioned that this project is based on Firefly, which Adobe is already using for other projects. To generate music with this tool, the user can enter a text prompt like “powerful rock,” “happy dance,” or “sad jazz”.
Also read – Apple Pulls the Plug on its Electric Car Project
Project Music GenAI Control will work similarly to your co-star. You can create or edit music with Adobe’s audio tool for your videos. Users can transform the generated video as per their preference. Adobe says- users could transform their generated audio based on a reference melody; adjust the tempo, structure, and repeating patterns of a piece of music; choose when to increase and decrease the audio’s intensity; extend the length of a clip; re-mix a section; or generate a seamlessly repeatable loop.
This new project has been developed in collaboration with the University of California and the School of Computer Science at Carnegie Mellon University. For now, Adobe’s new AI tool is in the “early stage” and it is not available for public use. Anything regarding the release date has also not been announced by Adobe yet.
