A look at everything new coming to Adobe Firefly, including the ability to generate sound effects and the power to leverage other AI video models into your Adobe workflows.
Adobe has made some major announcements today for its Firefly Video Model. One of the biggest announcements here is the introduction of a new Generate Sound Effects feature, which should make audio and video editing easier and more efficient.
Adobe Firefly is also set to gain new video capabilities, including improved motion fidelity and advanced video controls, all aimed at accelerating workflows and providing greater precision and style within Adobe’s apps.
Also, if you’re someone interested in keeping up with the latest AI video models from the likes of Runway and Google Veo, then you’ll be interested to learn more about how Adobe is planning to expand its services to offer these different models within the Firefly app.
Here’s everything you need to know about these updates.
Improved Adobe Firefly Model
While Adobe’s Firefly Video Model has always been good at generating things like dynamic landscapes and urban environments, it’s been wanting for some improvements with motion and behavior. This new update to the Firefly Video Model promises to improve motion fidelity with your video generations, which will now move more naturally with smoother transitions and lifelike accuracy.
Adobe Firefly creators will also now get expanded access to other AI video models within the Firefly app, including recently updated models like Runway’s Gen-4 Video and Google’s Veo3. Adobe shares that more partner models are coming soon to the Firefly app, too, including:
Topaz’s Image and Video Upscalers and Moonvalley’s Marey will be launching soon in Firefly Boards.
Luma AI’s Ray 2 and Pika 2.2, which are already available in Boards, will soon be added to Generate Video.
These models will assist with everything from storyboarding to fully animated video outputs, all of which you can access in the Firefly web and mobile apps, where users will be able to choose the AI model that best fits each part of their workflows.
From storyboarding to fully animated video outputs, Firefly web and mobile apps let you choose the AI model that best fits each part of your workflow, while keeping your style consistent and creative control intact.
Similar to what we’ve seen with other AI video models' director controls, Adobe is adding some new, powerful, and more advanced video controls to help elevate creators’ outputs. Here are some notable new advanced video control features:
Composition Reference for Video: Bring structure and consistency to your video creations. Upload a reference video, describe your vision, and Firefly will generate a new video that transfers the original composition to your generation—perfect for maintaining visual flow across scenes or repurposing existing content with a fresh look.
Style Presets: Apply a distinct visual style to your video with a single click. Choose from presets like claymation, anime, line art, or 2D to instantly set the tone. Whether you’re pitching a concept, building a creative brief, or finalizing your output, Style Presets help you stay consistent and speed up your workflow.
Keyframe Cropping: Stay in your creative flow with intuitive cropping tools. Upload your first and last frames, select how your image will be cropped, describe your scene, and Firefly will generate a video that fits your format—no need to jump between tools. It’s fast, flexible, and designed to match your vision from start to finish, while keeping your creative process effortless.
All of these features are designed to give creators more control, more speed, and more creative freedom.
Generate Sound Effects
The biggest news here, though, for certain video editors who have been tasked with finding, or even creating, sound effects for their various video projects over the years, is the introduction of a new Generate Sound Effects feature, which is currently being released as a beta update.
Just like Adobe’s other Firefly generative AI models, Generate Sound Effects (beta) promises to be commercially safe so that creators can easily create custom sounds like a lion’s roar or ambient nature sounds.
The Generate Sound Effects (beta) feature can be accessed with simple text prompts, which can generate the sound effects you might need. Users can use their voice to guide the timing and intensity of the sound, and once SFXs are added to their projects, users can export directly to Adobe Express.
If you’re curious to learn more about these new updates to Adobe Firefly, check out Adobe's website here.