After several months of experimentation, Adobe has rolled out its Firefly model for AI video generation more widely.
Adobe is taking a new step forward in AI-assisted content creation. After unveiling its Firefly model for video generation in October 2024, with availability to a very limited number of users, the creative software company has just made it available to everyone. At the same time, a new Firefly web app is being launched, offering a unified space for generating images, videos, and graphic elements.
Adobe Firefly: AI-powered video generation goes mainstream
Previously reserved for a handful of testers, Adobe’s Firefly video template is now available to everyone in public beta. Specifically, Firefly now allows creators to produce video clips from simple text descriptions, images, and even 3D sketches. Primarily aimed at content professionals, brands, and agencies, it includes several advanced tools:
- Text-to-Video and Image-to-Video: Firefly Video allows you to create short, 5-second animated sequences based on a text query, an image, or a combination of both. The tool then produces the clip in about 90 seconds, in 1080p resolution, with a 4K version expected soon.
- Precise Creative Controls: In addition to the information and details contained in your prompt, the Firefly web app interface has numerous options for adjusting desired camera angles, movements, and shots, using intuitive checkboxes.
- Creation of graphic elements and effects: The tool also allows the design of graphic elements and effects, such as lighting effects, smoke or custom animations, which can be associated with sequences in various Adobe editing software, including Premiere Pro.
- Key shot locking: By adding multiple frames, for example, it is possible to set a consistent start and end to ensure smooth transitions within a larger project.
During the Adobe demonstration that BDM was able to attend, Firefly’s video model appeared quite convincing. While, like all video generators today, the created sequences remain bathed in a sort of slow motion, the fluidity of camera movements and the fidelity of a video to its original image seem to be real successes.
The integration of generated video sequences or elements into Adobe’s creative software is of course one of the big strengths, particularly with Premiere Pro, where it is possible to add, edit or even extend sequences without leaving the tool.
A new Firefly web app to unify the creative experience
Adobe is accompanying this announcement with a complete redesign of its Firefly web application, offering a seemingly more fluid and intuitive experience, while integrating new tools related to video generation. These new features include:
- Easy access to creation: different buttons allow you to choose which type of AI tool you want to use on the web app, directly on the home page, where there is also a dialog box for writing prompts.
- Video Creation: Firefly’s new video template is directly accessible on the platform, as is its editing interface.
- Scene-to-Image: This experimental feature allows you to convert 3D sketches into textured images, realistic or not, which can then be animated using the video tool.
- Audio and video translation: Automatic generation of multilingual versions of audio and video content is available for around twenty languages while preserving the intonation and authenticity of the voices.
Finally, Adobe is also introducing new subscriptions and is preparing a premium offer:
- Firefly Standard: Access to 2,000 video/audio credits per month, or approximately 20 5-second videos in 1080p, for $9.99/month.
- Firefly Pro: Up to 7,000 credits per month (approximately 70 5-second videos in 1080p), at $29.99/month.
- Firefly Premium: An offering in preparation for large creators, with an even larger volume of videos and audio.
