Categories
News

Adobe object-aware editing engine and new generative AI

Adobe object-aware editing engine

At the Adobe MAX 2023 creativity event, Adobe unveiled a slew of innovative technologies and features that have the potential to transform the way we interact with digital content. Among the highlights of the event were the introduction of Project Stardust, an AI-powered object-aware editing engine, and a host of new generative AI capabilities that span across photo, video, audio use cases, and 3D, design, and fashion applications.

In addition to Project Stardust, Adobe also showcased 11 early-stage innovations, including a range of new generative AI capabilities. These capabilities are powered by Adobe Firefly, Adobe’s family of creative generative AI models, which is now commercially available. The commercial availability of Adobe Firefly expands the range of new applications beyond image generation, further enhancing the creative possibilities for users.

Among the new generative AI capabilities showcased at the Adobe MAX 2023 conference was Project See Through, an AI-powered tool that simplifies the process of removing reflections from photos. This tool has the potential to significantly streamline the photo editing process, enabling users to create high-quality images with less effort.

Another notable innovation was Project Fast Fill, which brings the power of Firefly generative AI to video. This technology offers an early look at what human-prompted generative AI could enable inside Adobe video editing tools. It’s a promising development that could revolutionize the way we edit and produce video content.

Highlights from the Adobe Max 2023 conference

Adobe photo innovations

  • Project Stardust is a powerful new object-aware editor that revolutionizes image editing and magically moves or removes objects simply by clicking on them. With Project Stardust, users can easily select, edit and delete complex elements in any image – enabling them to select persons in a photograph, move them to a different place in the composition and fill in the background where they were previously standing. Users can also change elements like the color of a person’s clothing and the position in which they’re standing – treating any image like a file with layers.
  • Project See Through is an AI-powered tool that makes it simple to remove reflections from photos. Glass reflections are an annoyance that everyone is familiar with in photos, obscuring the subject of the image, and often making it unusable. Though it’s difficult if not impossible to remove reflections using existing software, See Through dramatically simplifies the process.

Adobe video and audio

  • Project Fast Fill brings the power of Firefly generative AI to video for the first time. Leveraging Generative Fill technology – which Adobe Photoshop already uses to ease the addition, removal, or expansion of content in images with simple Firefly-powered text prompts – Project Fast Fill offers an early look at what human-prompted generative AI could enable inside Adobe video editing tools including Premiere Pro and After Effects.
  • Project Dub Dub Dub automates the video dubbing process, making a historically labor- and cost-intensive process as easy as clicking a button. Thanks to Project Dub Dub Dub’s AI capabilities, a recording or audio track of a video can be automatically translated to all supported languages while preserving the voice of the original speaker, temporally aligned with the original dialogue and ready to publish.
  • Project Scene Change makes it easy for video editors to composite a subject and scene, from two separate videos captured with different camera trajectories, into a scene with synchronized camera motion.
  • Project Res Up is a tool that easily converts video from low- to high-resolution using innovative diffusion-based upsampling technology.

Design projects teased by Adobe

  • Project Poseable represents a breakthrough in AI-based image generation models, making it easy for the image generator to seamlessly interact with large 3D objects, including poses from photos of real people. The prototype is integrated with Project Poseable which can create a 3D rendering from text input, take depth and perspective into consideration, and re-align the object. While creating 3D scenes with traditional skeletal systems is technically complex and time-consuming, Project Poseable offers an effortless alternative that makes it possible for anyone to expand their creative horizons.
  • Project Neo enables creators to incorporate 3D shapes in their 2D designs – all without requiring technical expertise in 3D creation tools. Today, creators of 2D designs such as infographics, posters, or logos are often limited in their ability to incorporate 3D elements given the complexity of those workflows, which can require years of experience. Project Neo enables creators to embrace simplified 3D design within 2D tools and methods.
  • Project Primrose blurs the line between technology and fashion, demonstrating the potential for flexible textile displays – and turning clothes into creative canvases. This interactive dress can offer infinite style possibilities, displaying content created with Adobe Firefly, After Effects, Stock,and Illustrator.
  • Project Glyph Ease makes customized lettering more accessible by streamlining the tedious design process of glyphs – the specific design and shape elements of each letter character. Beginning with a hand-drawn letter shape, Project Glyph Ease uses AI to automatically generate an entire set of glyphs matching the input lettering style. Users can then easily edit the generated glyphs in Illustrator.
  • Project Draw & Delight offers a suite of generative AI tools that helps anyone along their creation journey, from transforming initial ideas – often represented as rough doodles or scribbles – into polished and refined sketches, then experimenting with color palettes, style variations and different backgrounds.

Source : Adobe

Filed Under: Technology News, Top News





Latest timeswonderful Deals

Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, timeswonderful may earn an affiliate commission. Learn about our Disclosure Policy.

Categories
News

Adobe Project Stardust AI object-aware editing engine

Adobe Project Stardust AI object-aware editing engine

As well as unveiling a wealth of AI features it has rolled out to its suite of image and video applications. Adobe also teased projects that it is currently working on perhaps for a future release. As well as innovations in other areas such as the innovative interactive dress known as Project Primrose.

One of Adobe’s showcased future projects is Stardust, an object-aware editing engine that leverages artificial intelligence (AI) and generative AI to revolutionize the image editing process. This groundbreaking technology is designed to automate some of the most time-consuming aspects of image editing, such as filling in backgrounds, cutting out outlines for selection, blending lighting and color, and more.

Adobe Project Stardust

Project Stardust’s object-aware editing engine is a game-changer in the field of image editing. Unlike traditional image editing software like Adobe Firefly, which allows for object-specific modifications, Project Stardust takes this concept a step further. It offers a more automated and AI-driven approach, understanding the objects within an image and allowing for specific manipulations like cutting out outlines for selection. This object-awareness is a significant leap forward in image editing technology, enabling users to make precise modifications with ease and efficiency.

AI object-aware editing engine

“Project Stardust is an object-aware editing engine that uses artificial intelligence and generative AI to revolutionize image editing. This technology automates sometimes time-consuming parts of the image editing process — filling in backgrounds, cutting out outlines for selection, blending lighting and color, and more. In addition, the generative AI features let you add objects and make creative transformations. Stardust makes image editing more intuitive, accessible and time efficient for any user, regardless of skill level.”

“Aya Philémon is a product manager at Adobe who aims to empower others to make the most of their creative potential. Her research projects are inspired by both her professional and personal life experiences.”

  • Object-Awareness: The engine understands the objects within an image, allowing for specific manipulations like cutting out outlines for selection.
  • Generative AI Features: It goes beyond mere editing to generate new elements within the image, such as adding objects or creatively transforming existing ones.
  • Automation: The tool automates labor-intensive tasks like filling in backgrounds, blending lighting, and adjusting color, which speeds up the editing process.
  • Accessibility: It aims to be intuitive and user-friendly, making advanced image editing accessible to users of all skill levels.

But Project Stardust doesn’t stop at mere editing. It also incorporates generative AI features, which go beyond simple modifications to generate new elements within the image. This could include adding objects or creatively transforming existing ones. These generative AI features open up a world of creative possibilities, allowing users to make unique and imaginative transformations to their images.

Previous articles we have written that you might be interested in on the subject Adobe and AI art:

 Automation and accessibility

One of the most significant advantages of Project Stardust is its automation capabilities. The tool is designed to automate labor-intensive tasks like filling in backgrounds, blending lighting, and adjusting color. This automation not only speeds up the editing process but also reduces the potential for human error, resulting in a more seamless and efficient editing experience.

Perhaps one of the most exciting aspects of Project Stardust is its accessibility. The tool aims to be intuitive and user-friendly, making advanced image editing accessible to users of all skill levels. This accessibility is a testament to Adobe’s commitment to democratizing image editing, making it more accessible and intuitive for everyone, regardless of their skill level.

Adobe’s Project Stardust represents a significant advancement in image editing technology. Its object-aware editing engine, generative AI features, automation capabilities, and accessibility make it a powerful tool for anyone involved in image editing. Whether you’re a professional graphic designer or a hobbyist looking to enhance your photos, Project Stardust promises to make the image editing process more intuitive, accessible, and time-efficient.

What is an AI object-aware editing engine?

An AI object-aware editing engine is a software algorithm that uses artificial intelligence to identify and segregate different objects within a given visual medium. This enables more targeted editing capabilities. For example, in a photo containing people, animals, and landscapes, the engine could automatically recognize and isolate these elements so that the user can manipulate them independently. You could change the color of just the sky, blur only the background, or apply a filter to a specific person’s face, all without affecting other parts of the image.

In the video editing context, this engine could identify moving objects from frame to frame, allowing the user to apply edits to a specific object throughout the entire video clip without manually tracking it. The object-aware engine would automate the tedious task of frame-by-frame editing, making it easier for editors to create complex visual effects or adjustments. Overall, the engine would make the editing process more efficient and intuitive, letting users focus on creativity rather than technical details.

As soon Adobe releases more details on its new Project Stardust AI object-aware editing engine we will keep you up to speed as always.  In the meantime you can check out all the new features that have been rolled out to Adobe Firefly.

Filed Under: Technology News, Top News





Latest timeswonderful Deals

Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, timeswonderful may earn an affiliate commission. Learn about our Disclosure Policy.