Adobe Premiere now lets you generate AI video clips and sound effects directly inside your editing timeline using the new Generative Media tool powered by Adobe Firefly. Instead of switching between applications to create supplemental footage or audio, you can generate creative assets right where you’re editing.
In this tutorial, you’ll learn how to use the Generative Media tool in Adobe Premiere to create AI video clips, generate sound effects, guide results with reference images or recorded audio, and add AI-generated media to your project.
What Is the Generative Media Tool in Adobe Premiere?
The Generative Media tool allows you to generate video and audio directly inside Adobe Premiere. You can create supplemental footage to fill gaps in your timeline or generate sound effects to enhance your edit.
For example, you could generate a close-up shot of ocean waves to complement existing footage or create the sound of birds chirping to add atmosphere to an outdoor scene.
One of the biggest advantages is that you don’t have to leave Adobe Premiere to generate AI video and audio. You can create the assets and incorporate them into your project from the same timeline.
1. Find the Generative Media Tool
To get started, open your project in Adobe Premiere and locate the Generative Media tool in the Tools panel.
In the latest version covered in this tutorial, the tool is available at the bottom of the Tools panel. You may need to expand the tool menu to find it.
Once you’ve selected the tool, click and drag over an area of your timeline where you want to generate media. This creates a placeholder that behaves much like a regular clip.
You can move the placeholder, trim it, and adjust its position to fit your edit. For example, if there’s a gap between two clips, you can size the placeholder to fill that gap before generating new footage.
2. Generate an AI Video Clip
With the Generative Media tool selected, create a placeholder in your timeline and enter a text prompt describing the video you want to generate.
For example, if you’re editing footage of the ocean, you might use a prompt such as:
“A close-up shot of ocean water and gentle waves moving toward the shore.”
The more clearly you describe the shot you want, the easier it is to communicate your creative direction.
Choose an AI model and video settings
After entering your prompt, you can configure several generation options:
- AI model: Choose from the available models. In this tutorial, the example uses Veo 3.1.
- Resolution: Select the resolution available for your chosen model.
- Aspect ratio: Choose an aspect ratio that fits your project, such as 16:9 for a standard widescreen video.
- Duration: Set how long you want the generated clip to be. The example uses a four-second clip.
- Audio: Enable audio generation if the selected model supports it.
Keep in mind that available settings can vary depending on the model you choose. Not every AI model supports generating audio alongside video.
Use a reference frame to guide the result
If you want your generated video to look more consistent with your existing footage, you can provide a reference frame.
Adobe Premiere gives you options to use the previous frame, the next frame, or an image uploaded from your device. You can also use the sample option to select a frame from your existing footage in the Program Monitor.
A reference frame can help guide the generated clip’s visual appearance so it better complements the surrounding footage.
Once you’re happy with your prompt and settings, click Generate. Adobe Premiere will begin generating the video directly in your timeline.
When the clip is ready, preview it to see how well it fits your edit. In the tutorial example, the generated ocean footage looks similar to the original footage and includes generated wave sound effects.
3. Generate AI Sound Effects in Adobe Premiere
The Generative Media tool can also generate audio, including supplemental sound effects for your video.
To generate audio, select the tool and click and drag over an audio track in your timeline to create an audio placeholder.
Next, enter a text prompt describing the sound you want.
For example, you could enter:
“Natural outdoor ambience with small birds chirping intermittently.”
Adobe Premiere will use your prompt to generate a sound effect that you can place directly into your edit.
Guide audio generation with a recorded sample
You can also provide an audio sample to help guide the generated sound.
Click the record button and record a simple example of the sound or rhythm you want. You don’t need to produce a perfect sound effect yourself. In the tutorial, the example is a quick imitation of birds chirping.
Once you’ve recorded your sample, play it back to make sure you’re happy with it. Then click Generate.
The tool produces four different versions of the sound effect, allowing you to compare the results and choose the one that works best for your project.
Listen to each version before making your selection. Even when multiple results follow the rhythm of your sample, they may differ in tone, timing, and overall sound.
After choosing a result, you can add it to your timeline and combine it with your existing audio or AI-generated video.
4. Check Your Adobe Firefly AI Credits
The Generative Media tool uses AI credits, so it’s worth checking your available balance before generating multiple clips or sound effects.
During the tutorial, the example video generation displays a cost of 200 AI credits. The exact credit cost may vary depending on the model and generation settings.
To check your remaining credits, click the credit balance button in the tool’s interface.
If you plan to use AI-generated media regularly, keep track of your available credits and consider the cost of generating multiple variations as part of your editing workflow.
5. Add AI-Generated Media to Your Editing Workflow
Once you’ve generated your video clips and sound effects, you can use them alongside your original footage directly in Adobe Premiere.
Here are a few ways this can help your workflow:
- Fill gaps in your timeline: Generate supplemental B-roll when you need an extra shot.
- Create additional visual coverage: Add a detail shot or establishing shot that complements your existing footage.
- Enhance your sound design: Generate ambient audio and sound effects to help a scene feel more complete.
- Explore creative options: Generate multiple versions and compare them before choosing the best fit.
- Save time switching applications: Generate supported video and audio assets without leaving your editing timeline to open Adobe Firefly separately.
AI-generated media is particularly useful when you need an additional creative element that wasn’t captured during filming. However, you should still review each result carefully to make sure it fits the visual style, pacing, and sound design of your project.
Final Thoughts
The Generative Media tool makes it possible to create AI-generated video and audio directly inside Adobe Premiere. You can generate supplemental footage, guide results with reference frames, create sound effects using text prompts or recorded samples, and add the results to your timeline without leaving your editing application.
If you regularly edit videos and need extra B-roll or sound effects, this tool can be a useful addition to your workflow.
The key is to treat generated media as another creative resource: experiment with prompts, compare the available results, and choose the clips and sounds that best support your edit.
Have questions about using the Generative Media tool in Adobe Premiere? Leave a comment below!
Frequently Asked Questions
Can you generate AI video directly in Adobe Premiere?
Yes. The Generative Media tool lets you generate video clips directly in your Adobe Premiere timeline using supported AI models. You can create a timeline placeholder, enter a prompt, configure the available settings, and generate a clip.
Can Adobe Premiere generate AI sound effects?
Yes. The Generative Media tool can generate audio from text prompts. It also supports using a recorded audio sample to guide generation, depending on the available options.
Can you add audio to AI-generated video in Adobe Premiere?
Yes, when the selected model supports audio generation. The tool’s audio options depend on the model, so not every model will generate sound alongside video.
Can you use a reference image when generating video in Adobe Premiere?
The tool provides options to use a previous or next frame, upload an image, or select a sample frame from existing footage. These references can help guide the appearance of your generated video.
Does the Generative Media tool use AI credits?
Yes. Generating media uses AI credits. The amount required can vary depending on the selected model and settings. You can check your remaining balance through the credit balance button in the tool’s interface.
Do you need to leave Adobe Premiere to use Adobe Firefly for video generation?
For supported Generative Media features, you can generate video and audio directly inside Adobe Premiere instead of switching to Adobe Firefly in a separate application.