Adobe announced a significant expansion of its Firefly generative AI platform, introducing video creation and editing capabilities slated for release later this year. The new Firefly Video Model positions Adobe to compete directly with emerging players in the generative video space, including OpenAI's Sora.
Set to debut in beta form, the video expansion to the Firefly tool will integrate with Adobe's flagship video editing software, Premiere Pro. This integration aims to streamline common editorial tasks and expand creative possibilities for video professionals.
The model boasts several notable features, including the capacity to generate B-roll footage from text prompts, with Adobe asserting that high-quality clips can be produced in under two minutes. This capability mirrors the pure video generation offered by platforms like Sora, Kling, or Dream Machine.
Another new tool, Generative Extend, enables editors to lengthen existing clips, smoothing transitions and adjusting timing to align perfectly with audio cues. Moreover, the AI can address video timeline gaps, helping to resolve continuity issues in editing by contextually connecting two clips within the same timeline—a feature that distinguishes Adobe from its competitors.
Procreate App Takes Stand Against Generative AI, Shunning Adobe’s Approach
"I really fucking hate generative AI," James Cuda, CEO of Procreate, declared in a video posted on X, marking a clear stance on what his app company thinks about Generative AI technology. His statement marks a stark departure from the AI-embracing stance of competitors in the space. "I don't like what's happening in the industry, and I don't like what it's doing to artists," he continued, announcing that the popular Procreate app for iOS devices won't be jumping on the generative AI bandwagon....
The Firefly Video Model also incorporates the ability to eliminate unwanted elements from footage, akin to Photoshop's content-aware fill. Adobe says its generative AI technology edits each frame and maintains consistency throughout the timeline, turning a typically slow, manual process into a faster, automated one.
Additionally, the model can produce atmospheric elements like fire, smoke, and water, thereby enhancing video compositing options. While not revolutionary, this capability does add flexibility to Adobe’s video editing suite. Also, just like other existing generative video tools, Firefly supports various camera movements and angles.
The samples shared in the announcement show a pretty powerful model, capable of understanding the context and providing coherent generations.
Finally, Adobe emphasizes that Firefly is “commercial safe”—trained exclusively on licensed content, mitigating potential copyright concerns. This may be a strategic move considering that Adobe's foray into generative AI has been rocky—to put it mildly.
Kling AI Video Generator Now Available Globally to Take on OpenAI's Sora
Kuaishou's Kling AI has gone worldwide, ditching its China-only restrictions with the global launch of Kling AI version 1.0. The AI video generator platform is now accessible to users worldwide at KlingAI.com, where registration requires just an email address. Upon signing up, users receive 66 free daily credits for video creation. The platform supports both text-to-video and image-plus-text-to-video generation, putting it in direct competition with OpenAI's much-hyped Sora—which remains only av...
When the company first rolled out AI features in Photoshop, reactions were somewhat mixed, with some creatives seeing potential and others being more skeptical. But then Adobe stepped in it big time. A license change appeared to give Adobe the green light to use customer data, and all hell broke loose.
Content creators, from YouTube stars to industry analysts, raised their voices against the company—even recommending ditching the suite in favor of less popular (but more pro-creator, anti-AI) competitors.
Those competitors smelled blood in the water. Procreate's CEO didn't mince words, declaring he "fucking hated AI" and swearing that tech would never reach their app. Affinity swooped in and assured its users that there wouldn't be generative AI on their suite of products either.
To clarify, we are not developing any generative AI tech and are against anything which undermines human talent or tramples on artists' IP. Any ML/AI features will be workflow focused. We are 100% a champion of human creativity and always will be. https://t.co/16jq9FM9gy
— Affinity (@affinitybyserif) November 9, 2023
Adobe scrambled to patch things up, tweaking their terms of service, but the damage was done. Their reputation took a beating, especially given the groundswell of anti-AI sentiment in creative circles.
Despite the PR nightmare, Adobe remains firm in its pro-AI vision. Just a few weeks ago, the company introduced Magic Fixup, a technique that applies more sophisticated image editing capabilities than normal image editors after being trained on video instead of still images.
The company has opened a waitlist for the Firefly Video Model beta, though specific release dates have not been announced.
