As part of the annual MAX 2017 conference, Adobe introduced new tools for editing photos and video using artificial intelligence technologies. The idea is to greatly facilitate the execution of certain operations that take a long time. It's worth noting that Photoshop already uses such tools. One of the most famous is the Content-Aware Fill, which serves to automatically fill the selected area with other parts of the same image.
The first announced tool was Scene Stitch. It performs the same function as the Content-Aware Fill, but to fill the selected site, the elements most suitable to the scene from the Adobe online library numbering hundreds of millions of photos are used. As a result, the user gets to choose a few most successful, in the opinion of the program, options.
With the help of Scene Stitch, you can not only remove an unwanted object from the frame, whether it's an accidentally passing person or a car, but also completely replace most of the image. As usual, at the start, algorithms are often mistaken, but with time they will improve the result.
The second function presented was a tool called Project Cloak. In short, this is a complete analogue of Content-Aware Fill, but intended for video processing. With its help you can easily remove unwanted objects from the already filmed clip. As the developers told, Project Cloak first fills the selected area of ??one frame with fragments, and then uses the same effect on all subsequent ones, taking into account the change in perspective, lighting and other parameters.
When new features become available to users - not reported.