Generative Extend in Premiere Pro: Adobe’s AI Tool That Could Change Video Editing

Adobe Premiere Pro’s new AI tool could save video editors hours of time

Adobe has released Photoshop 25.9, the latest public beta of its image-editing software, adding a range of generative AI capabilities powered by its new Firefly Image 3 AI model. One of the first AI tools released was generative fill in Photoshop, which lets creators fill specific shapes or areas with AI-generated imagery. Now, generative fill is one of the most popular Photoshop tools, on par with the crop tool. Of the 11 billion images created using Adobe’s AI model Firefly, 7 billion of them were generated in Photoshop. Put another way, an average of 23 million images a day are made using generative fill, Nielson said. Part of the appeal of Adobe’s updates is that they are legitimate use cases for generative AI for professionals.

The possibility of « losing a generation of artists, » as she put it, is worrisome. There’s no shortage of experts arguing about whether AI is capable of producing art, but artists have already lost jobs in favor of AI, especially in entry-level or freelance positions. Job experts predict that AI is likely to reduce the number of overall job opportunities as it gets better at automating more menial tasks.

How Generative AI is unlocking creativity – the Adobe Blog

How Generative AI is unlocking creativity.

Posted: Thu, 17 Oct 2024 07:00:00 GMT [source]

Lightroom’s generative remove has better object detection and selection to remove photobombers and other intrusive elements. One is the text and image to video generation that Adobe previewed last month, accessible in the Firefly web app at firefly.adobe.com. This enables users to create five-second, 720p-resolution videos from natural-language text prompts. It’s also possible to generate video using still images as a prompt, meaning a photograph or illustration could be used to create b-roll footage. Adobe’s Firefly cloud service, which provides access to AI-based design tools, is also receiving new video editing capabilities. One of the additions is a feature that generates five-second clips based on text prompts.

Adobe’s Firefly ‘Bulk Create’ lets users edit thousands of images at once

We actively engage with policymakers and industry groups to help shape policy that balances innovation with ethical considerations. Our discussions with policymakers focus on our approach to AI and the importance of developing technology to enhance human experiences. Regulators seek practical solutions to address current challenges and by presenting frameworks like our AI Ethics principles—developed collaboratively and applied consistently in our AI-powered features—we foster more productive discussions.

It is fascinating how Adobe discusses and frames generative AI tools compared to its competitors. Unlike companies like OpenAI and Stability AI, Adobe has been serving creative professionals for decades — Adobe didn’t just pop up when the AI door opened. Adobe’s 30-plus years of creating tools for visual artists means its core audience is not universally champing at the bit for more generative AI technology; many are concerned about how AI may harm their business and the art space at large. Adobe pledges to attach Content Credentials to assets produced within its applications so users can see how it was made and plans to apply its approaches to the planned integration of third-party AI models. As you can see when comparing the sets of images in the figures above and below… you can have great influence over your set of generated images through this control.

Expand videos that are too short without reshooting

While Generative Extend might give them the footage they need, other creatives may be less enthused. It may mean that reshoots are no longer required, taking days of work (and income) away from the cast and crew. Generative Extend is a Premiere Pro feature that Adobe previewed earlier this year. It enables editors to add generated footage and audio to the start or end of a clip. Adobe says the tool can also correct eyelines and actions that change unexpectedly in the middle of a shot. Generative AI is already reshaping digital experiences in India, particularly in ecommerce and travel.

This technology also enables the extension of video clips and the smoothing of transitions, with integration into Adobe’s video editing software, Premiere Pro. Adobe has expanded its Firefly family of creative generative AI models to video, in addition to new breakthroughs in its Image, Vector and Design models. The Firefly Video Model, now in limited public beta, is the first publicly available video model designed to be “commercially safe,” Adobe said.

The company says it’s committed to taking a creator-friendly approach and developing AI following the company’s AI Ethics with principles of accountability, responsibility and transparency. This includes respecting creators’ rights and never training the development of AI by using customer content. The new tools will also help across all design workflows whether that’s creating variations of advertising and marketing graphics or mocking up digital drawings and illustrations. For example, it’s now easier to add patterns to fashion silhouettes for mood boards. And since Adobe Firefly’s features are integrated into the products you already know and likely use so often, you won’t have to waste time navigating new software. Instead, users will need to either click on their profile picture on the Firefly website or do the same inside Adobe’s Creative Cloud desktop or web app.

This is markedly different from most AI art programs that are targeted at amateurs and non-artists — professional photographers and illustrators can create better images than an AI image generator, after all. Making it quicker to fix those kinds of errors is the goal of Adobe’s AI, Stephen Nielson, senior director of product manager for Photoshop, told me. Photoshop also has new and intuitive features to accelerate core creative workflows and streamline repetitive tasks by using the Selection Brush Tool, Adjustment Brush Tool and enhancements to the Type Tool and Contextual Taskbar.

• For those who want it, it’s available in all versions of Adobe Lightroom beginning today as an “early access” feature.
• Several of Photoshop’s existing AI tools are designed for tasks like eliminating power lines, garbage cans, and other distractions from the background of a photo.
• When it comes to generative artificial intelligence (AI), one company that has been at the forefront on the software side is Adobe (ADBE -0.43%).
• Retype is another nifty tool that converts static text in images into editable text.

This is great for taking pre-made designs and color schemes and applying your brand to them, without spending hours recoloring or changing fonts and other elements. Photoshop Beta’s Generative Workspace allows your generated images to have a new home. Previously, when generating images, you had to manually click to open them and save them each as a file or an artboard—but the Generative Workspace allows you to keep track of all your generated images across the Adobe suite. « AI tools can either be used for evil or to steal stuff, but it can also be used for good, to make your process a lot more efficient, » said Acevedo.

Adobe also hopes that by building this AI for professionals, it won’t raise the typical red flags that other AI programs do. If it’s integrated well, creators might be more inclined to take advantage of it, said Alexandru Costin, vice president of generative AI at Adobe. Another feature, Lens Blur, allows you to blur any part of a photo to create more professional-looking cityscapes, portraits, or street photography. If you have a photo you love but want to swap the background, the latest Photoshop update allows you to generate a replacement background that matches the lighting, shadows, and perspective of the subject in the forefront.

Well, that’s possible to change, too, and like style variations, users change the composition with a descriptive text prompt. I saw this new direction for myself at this year’s Adobe MAX, where new announcements focused on AI as tools rather than gimmicks. New tools like Project Turntable, that enables you to easily rotate 2D vector art in 3D by generating the missing data to fill in the image – a 2D horse now has four legs as its turned.

Google ups Workspace price, makes Gemini AI features available for free

Adobe said it only trains the video model on stock footage and public domain data that it has rights to use for training its AI models. Adobe has also released more info about its own promises for “responsible innovation” for Firefly and this new generative AI video model. Adobe promises that its Firefly generative AI models are trained only on licensed content, such as Adobe Stock and public domain content. It also gets new intuitive features like the Generate Image feature, powered by the new Firefly Image 3 Model. Additionally, the Enhance Detail feature for Generative Fill has been improved to provide greater sharpness and detail for large images. Moreover,the new Selection Brush tool simplifies the process of selecting specific objects for editing.

In this article, we’ll be exploring some of the more detailed features of Firefly in general. While we will be doing so from the perspective of the text-to-image module, much of what we cover will be applicable to other modules and procedures as well. The Substance 3D Collection is revolutionizing the ideation stage of 3D creation with powerful generative AI features in Substance 3D Sampler and Stager.

What to do if Generative Fill is grayed out in Adobe Photoshop AI

One of the biggest announcements for videographers during Adobe Max 2024 is the ability to expand a clip that’s too short. Dubbed generative extend, the tool uses AI to add both video and sound to the end of an existing clip. In demonstrations of the tool, Adobe showed off generated video that looked very similar to the original clip. I would prefer to continue paying Adobe USD 9.99 monthly, just as I have been doing for the most part of my professional career. I definitely don’t want to have to pay over 50% more at USD 14.99 just to continue paying monthly instead of an upfront annual fee. What could make a lot of us photographers happy is if Adobe continued to allow us to keep this plan at 9.99 a month and exclude all the generative AI features they claim to so generously be adding for our benefit.

From playground to production: How to jump-start your content transformation with generative AI – the Adobe Blog

From playground to production: How to jump-start your content transformation with generative AI.

Posted: Thu, 20 Jun 2024 07:00:00 GMT [source]

Each step in the creative process can be enhanced with generative AI in Adobe Photoshop. Similarly, Adobe’s newly-announced Generative Remove tool in Lightroom — a tool that is classified as “Early Access beta” — also incurs a Generative Credit per use. These usage number exist now because it says it wants to be transparent about usage so that when it does start enforcing these limits, users can see how much they’ve used historically. It’s not clear when Adobe will actually start to enforce limits, such as app slowdowns, if Credits are expended. Adobe tells PetaPixel that for most of its plans, it has not started enforcement when users hit a monthly limit even if it is actively tracking use. The company recorded $504 million in new digital media annualized recurring revenue (ARR), ending the quarter with digital media ARR of $16.76 billion.

• The concern for creatives is seeing their work potentially lumped in with those tasks.
• Adobe could improve the user experience dramatically by simply including the reason a generation gets flagged as a guideline violation.
• Note that Content Credentials are applied in this case just the same as they are when downloading an image.

Adobe also announced its plans to bring third-party generative AI models directly into its applications, including Premiere Pro, although the timeline is murky for now. Clicking the Favorite control will add the generated image to your Firefly Favorites so that you can return to the generated set of images for further manipulation or to download later on. Choose one of the generated images to work with and hover your mouse across the image to reveal a set of controls. After Effects now also has an RTX GPU-powered Advanced 3D Renderer that accelerates the processing-intensive and time-consuming task of applying HDRI lighting — lowering creative barriers to entry while improving content realism. Rendering can be done 30% faster on a GeForce RTX 4090 GPU over the previous generation. The latest After Effects release features an expanded range of 3D tools that enable creators to embed 3D animations, cast ultra-realistic shadows on 2D objects and isolate effects in 3D space.

“Generative Extend” is among the most interesting generative AI tools Adobe plans to bring to Premiere Pro. It promises to seamlessly add frames in clips to make them longer, allowing editors to create smoother transitions. Adobe says this “breakthrough technology” will enable editors to create extra media for fine-tuning edits, hold a shot for an extra beat, and better cover transitions.

Firefly applies metadata to any generated image in the form of content credentials and the image download process begins. One reason is to get general user feedback to improve the experience of using the product… and the other is to influence the generative models so that users receive the output that is expected. There are also new Firefly-powered features in Substance 3D Viewer, like Text to 3D and 3D Model to Image, that combine text prompts and 3D objects to give artists more control when generating new scenes and variations. Just a few weeks ago, the company introduced Magic Fixup, a technique that applies more sophisticated image editing capabilities than normal image editors after being trained on video instead of still images. Another new tool, Generative Extend, enables editors to lengthen existing clips, smoothing transitions and adjusting timing to align perfectly with audio cues. Moreover, the AI can address video timeline gaps, helping to resolve continuity issues in editing by contextually connecting two clips within the same timeline—a feature that distinguishes Adobe from its competitors.

Adobe is also investing in better ways to help differentiate content created by AI, which is one of the biggest issues with AI-generated content. Recently Adobe launched a new Content Authenticity app for artists to create content credentials, a kind of digital signature that lets artists invisibly sign their work and disclose any AI used. « I think Adobe has done such a great job of integrating new tools to make the process easier, » said Angel Acevedo, graphic designer and director of the apparel company God is a designer. « We saw stuff that’s gonna streamline the whole process and make you a little bit more efficient and productive. »

Adobe does not seem to have any plans to put warnings or notifications in its apps to alert users when they are running low on Credits either, even when the company does eventually enforce these limits. This biggest issue, though, was the company’s projection of about $550 million in new digital media ARR for the quarter. In Q4 of last year, the company generated $569 million in new digital media ARR, so this would be a deceleration and could lead to lower revenue growth in the future. Adobe said the lower new ARR forecast was due to timing issues, such as Cyber Monday falling into the next quarter this fiscal year.

20 Contact Center AI Use Cases to TransformAgentand Customer Experiences

Generative AI in Customer Experience: The 11 Most Implemented Use Cases

As such, the technology removes the burden that traditionally impacts agents and has proven effective in lowering contact center burnout rates. As a result, its customers can be more self-sufficient, minimizing IT involvement in day-to-day maintenance and support. Additionally, unlike point solutions, Genesys Cloud AI is optimized for CX and ready to deploy on day one, enabling faster time to value.

Avaya built the showcase on its Avaya Experience Platform, which integrates contact center data and operations to provide centralized insights and boost performance. An avatar-based, virtual contact center operations manager advises and acts on behalf of contact center leaders. The vendor explained how the agents are also capable of analyzing inputs from various points in the customer journey and taking independent actions to enhance workflows, including assisting agents and supervisors. ULAP Networks is positioning itself as an alternative to AI-powered UC solutions, offering customers a secure, AI-free option for their unified communications needs – ULAP Voice. McDonald suggests that by not using any AI, ULAP Networks’ solution avoids the potential risks and misuse concerns around AI outlined here.

Before bashing auto-summarizations completely, it’s critical to remember the time before they were a possibility. The last 18 months have seen a huge uptick in service providers implementing auto-summarizations. Automation is incredibly useful in the contact center, and the development of agentic AI will soon make it much more accessible. From there, the assist can advise supervisors on when they need to “barge in” to a call or “whisper” advice to their team members.

One potential caution is that if agents can’t correctly adjudge the customer’s tone of voice, they may not deliver sufficient empathy or grasp the immediacy of the issue. Conducted by Gartner, the findings are based on a survey of almost 6,000 customers across four continents. The results outline a clear disconnect between companies and customers regarding the use of AI. Despite pressure for CX leaders to adopt more GenAI solutions, customers are turning their back on the tech. Conversational AI enables a brand’s call centers to fully or partially automate conversations on messaging channels at scale. AI-powered messaging played a large role in many brand’s pandemic responses, which was simply the acceleration of a trend that had already begun, according to Rob LoCascio, CEO ofLivePerson.

Alerting Supervisors to Agent Issues

That’s before we consider the evolution of these platforms with self-service and AI. For instance, they may run an ongoing campaign to automatically send a discount code to “neutral” customers so they can build better connections with them. Alternatively, they could trigger alerts to engage with at-risk customers to recover the relationship. For example, HubSpot has a Customer Health model, which mixes it with other insights – such as product usage data – to categorize a customer as “healthy”, “neutral”, or “at-risk”. However, there are often gaps where there is no knowledge article related to the customer’s query. One critical reason is that many contact centers cannot unlock the necessary data or discipline to truly benefit from AI.

Is This the Year AI Dominates the Call Center? – CMSWire

Is This the Year AI Dominates the Call Center?.

Posted: Mon, 02 Dec 2024 08:00:00 GMT [source]

Many customers embrace automation, preferring not to talk to someone if they can get fast help fixing a problem quickly and move on. Such statistics highlight the opportunity customer service teams have to utilize the technology and transform their daily operations. Copilots and virtual assistants are continuing to drive efficiency across customer-facing teams. AudioCodes VoiceAI Connect service is an excellent example of a solution that can help companies overcome common mistakes.

QA Automation – How Far Can We Push AI?

Keeping track of all agents’ performance metrics in a contact center can be time-consuming and complex. A contact center virtual assistant can help supervisors by alerting them to positive recognition and coaching opportunities. During post-contact processing, virtual assistants can automatically tag each customer’s conversation with a disposition code. However, insights into customer sentiment can also provide agents with insights into where they can proactively improve. Indeed, leveraged correctly, they can cut long waiting times, track customer sentiment, increase sales, and offer service teams live coaching.

Even the regulations created by the EU and US require companies to ethically implement AI in a way that augments human employees, rather than replacing them entirely. We can expect is that organizations, nations, and individual customers will look to the regulations created by the EU and US for inspiration. We saw a similar process taking place when the EU introduced their General Data Protection Regulation (GDPR) guidelines a few years ago. AI keeps track of project timelines and proactively informs the customer of potential delays, providing alternative solutions. Based on a customer’s travel history, the AI suggests a customized itinerary, books local experiences, and offers restaurant reservations. For instance, generative AI can make it easier to monitor email inboxes and social channels, and respond to customer queries rapidly.

This is the use case that most contact centers tend to start with as it’s internally facing. Any problems may inconvenience agents but will help protect the brand from having unhappy customers. With a contact center virtual assistant, supervisors can get alerts for signs of negative employee customer sentiment and proactively step in to address the issue. They could even offer agents the option to take a break, reducing the risk of dissatisfaction that may lead to absenteeism or turnover.

• Using generative AI, contact centers are now about to deliver hyper-personalized services.
• Agent assist will correct the imbalance in a contact center agent’s time so they can better connect with customers and focus on high-value interactions.
• An AI-powered assistant can boost agent productivity, surfacing information from databases and other applications, based on identified keywords.
• These are out of Amelia’s scope due to regulatory scrutiny, so JetBlue and ASAPP have added guardrails to ensure such queries escalate immediately to a crew member.

Decreasing wait times while increasing volume allowed business to foster stronger relationships with an expanded network of customers,” explained LoCascio. Sentiment analysis using a large language model goes far beyond the previous examples, as it can understand the entire context of a conversation through the transcript. They can also pick up on nuances such as sarcasm, providing accurate insights into conversations. However, this method is the least accurate, as it looks for the words and terms regardless of context and cannot pick up on verbal cues.

Moreover, as bot-led interactions become more prevalent, agents will play a role in training bots so they deliver a similar level of service. As such, new agents will feel more confident and require less training since agent assist lifts the burden of performing specific tasks. However, with agent assist, contact centers can automate that process with AI, which – according to the CCaaS vendor – only makes errors in three percent of cases. With the right support, business leaders can stay ahead of AI trends, implement the latest technology, and ensure they’re future proofing their approach to compliance. In the meantime, contact center leaders will need to prioritize working with vendors who already understand the risks, emerging challenges, and potential regulatory requirements for generative AI.

The contact center industry has experienced three distinct generations of AI & automation. For example, its automatic summarization feature achieves higher accuracy in case summary compliance and disposition than manual agent efforts, removing agent bias or manipulation. By analyzing procedural documentation and executing logical thought chains, Copilot enables accurate and efficient problem resolution. As such, the vendor thinks there are still many more lessons from retail it can share to help others become similarly customer-obsessed. Security is also critical to how AWS starts with the development of all its AI services, as it’s a lot easier to start with security in the development rather than bolt it on later.

These tools can pinpoint keywords in conversations and apply tags to service requests and tickets, streamlining the routing process. GenAI is aiding the social media cycle by updating posts in real time based on audience engagement, monitoring social analytics, and spotting hot topics to post about. Contact centers benefit significantly from these advancements, achieving faster resolution times, enhanced customer satisfaction, and reduced operational costs. GenAI can scour conversation transcripts to score each customer interaction and evaluate the agent’s performance.

The Future of AI Agent Assist Solutions

This proactive approach greatly enhances operational efficiency and improves customer satisfaction. For instance, agent assist solutions integrated with extended reality platforms (augmented, virtual, and mixed reality), can empower teams to deliver service in an immersive environment. Agents can step into an extended reality landscape to onboard customers, deliver demonstrations, and more, all while still having access to their AI support system.

From there, they pass them through to the best-suited agent – live or virtual – in the channel of their choice. From offering rapid AI innovation to delivering new engagement channels, CCaaS platforms promised so much. Available to be leveraged fully or semi-autonomously, the agents work 24/7, delivering high efficiency by handling tasks quickly and at scale. Now, contact centers can select and action AI solutions, harnessing their tailored AI model and delivering new-look experiences. Here, contact centers can assess where their pain points lie, using tools like large language models (LLMs) to reduce each interaction down to the core contact driver.

You can think of it as a complex auto-complete feature that can create sentences based on a probable series of words. On top of that, we can more easily track customer satisfaction thanks to improvements in sentiment analysis. In this vein, Griessel shares several best practices for supporting agents in handling more complex tasks before offering advice for augmenting a high-performing team with AI.

A recent study has revealed that the majority of customers do not want companies to use AI in their customer service offerings. Predictive behavioral routing (PBR) leverages AI and analytics to match call center customers with agents whose communication styles are most compatible with the caller’s personality. “The technology not only empowered businesses to communicate with customers as physical locations shuttered but gave them the ability to do so on a mass scale.

Automating Social Media Management Processes (39.9 percent)

For instance, if a customer says, “well that’s just great,” most would understand it to be sarcastic, but the sentiment analysis tool would still pick up the word “great” and assume it’s a positive statement. Both AI Rewriter and AI Translator are now available as part of Talkdesk Copilot, an AI assistant that aids agents with customer interactions. AI solutions can even leverage machine learning to make accurate predictions about call volumes and customer requirements.

In enabling this transfer of context – across channels – virtual assistants can support the development of an omnichannel contact center. A contact center virtual assistant can simplify this process by summarizing the conversation so far and ensuring that the summary passes through to the next person talking to the customer. Yet, during certain conversations, mid-discussion tasks can take up a lot of time, like entering details into a form, copying and pasting information, or initiating processes like refunding customers. As such, some virtual assistants can automatically take notes when a customer talks for the agent, so they can keep track of critical topics throughout a discussion. Additionally, they are smarter than ever, leveraging machine learning, natural language processing (NLP), generative AI, and advanced algorithms to make contact center teams more productive and efficient. The tool bombards virtual agent applications with mock customer conversations to test how well the bot stands up to various inputs.

• Sentiment analysis is becoming sophisticated, aiding companies as they look for ways to learn more about customers and what drives loyalty and retention rates.
• They enable customer autonomous self-service strategies and provide agents with the information they need to resolve problems, sell products, and handle various types of customer interactions.
• NLP (Natural Language Processing) is one of the most valuable components of AI in the contact center.
• Agent after call work dropped by 35%, potentially enabling agents to handle more calls effectively.
• This requires proper instrumentation to understand and govern agent behavior, and the agents themselves will need to understand when to check back with a human agent or customer.
• After all, the intelligent contact center of the future has AI everywhere, with many use cases hinging on AI-augmented data sets.

To tackle such issues and create a more trustworthy metric, contact center QA provider evaluagent has added an Expected Net Promoter Score (xNPS) feature into its platform. Indeed, JetBlue could prioritize its primary contact reasons, ensure the AI agent has the necessary knowledge to handle applicable queries, and orchestrate effective experiences. Before implementing an AI Agent, contact centers must gain a granular understanding of their demand drivers. In doing so, JetBlue’s team reviews automated interactions, guides improvements, minimizes the chances of hallucinations, and fast-tracks Amelia’s learning.

With AI-powered monitoring tools, companies can automate the quality management process, rapidly scoring conversations based on pre-set criteria. Some solutions can even send instant alerts to business leaders and supervisors when issues emerge to help proactively improve the customer experience. Like conversational AI, generative AI tools can have a huge impact on customer service. They can understand the input shared by customers in real time and use their knowledge and data to help agents deliver more personalized, intuitive experiences. AI technology gives organizations the power to deliver personalized 24/7 service to consumers on a range of channels, through bots and virtual agents.

While the solution is in beta, the contact center QA provider believes the results are “promising” when tested against real-life NPS data. Indeed, the bot detects the intent change and presents a message to refocus the customer, pull the conversation back on track, and improve containment rates. Alongside the answer, the GenAI-powered bot cites the sources of information it leveraged, which the customer can access if they wish to dig deeper. Yet, sometimes, there is no knowledge article for the solution to leverage as the basis of its response. Elsewhere, a Japanese telecoms provider is trialing a similar software that modifies the tone of irate customers.

As a result, businesses can adjust the customer journey to avoid failure demand, reduce overall call volumes, and enhance customer experiences. “Say we can enable your contact center to automate your intelligent voice response system. You can use that information to improve management of your contact center,” Grubb says. While the impact of advanced AI algorithms can be felt everywhere, it’s particularly prominent in the contact center.

Agent assist will correct the imbalance in a contact center agent’s time so they can better connect with customers and focus on high-value interactions. Descope CIAM, a ‘drag-and-drop’ customer identity and access management (CIAM) platform has now been integrated into 8×8 CPaaS to improve security and fraud protections. Its no-code visual workflows allow businesses to create the entire user journey, authentication, authorisation, and identity management into ‘any’ app. According to EU rules, companies will need to disclose which content is created by generative AI, publish summaries of data used for training, and design models to ensure they don’t generate unsafe or dangerous content.