Last night at Adobe MAX, the company unveiled several sneak peeks at future projects Adobe is currently working to include in its Creative Cloud suite. Three of those sneak peeks will be of particular interest to anyone working in the post-production realm.
Cloak
At the end of its sneak peeks, Adobe unveiled Cloak, which is content-aware-fill for video. Cloak enables removing unwanted things from a video by imagining what would appear if these unwanted things were removed.
One of the most striking features of Cloak is its ability to imagine what the pixels behind an element might look like when they are never actually revealed in any frame of the video, then automatically generate those pixels frame-by-frame to match the rest of the shot. To demonstrate this feature, Adobe used Cloak to remove the strap of a man's backpack sitting across his chest as he walks through a canyon in varied light.
Adobe Cloak in action.Credit: Adobe
SonicScape
For VR editors, syncing up ambisonic audio with the proper focal point in 360° video when viewers turn their heads to look at the world around them can be a challenge. Adobe presented a sneak peek of SonicScape, an audio editing tool that visualizes ambisonics in 360° video using color particles. This visualization will help video editors see where sound is located in context.
In addition to showing sound visually over the video with color particles, SonicScape provides a wireframe overlay to allow editors the ability to easily drag the audio visualization to the exact spot in the visual from which the sound emanates. SonicScape also lets editors add ambient sound FX, adjusting for the distance between the visual and where the viewer is standing.
Adobe SonicScapeCredit: Adobe
Sidewinder
One of the major limitations of 360° video today is the viewer is essentially locked into exploring the video from the same level as the camera's position. If the viewer tries to step sideways or kneel down, the VR display can't adjust to let the viewer truly explore the world.
With Sidewinder, Adobe uses the depth map associated with 360° video and applies novel view synthesis to enable moving of the head positionally which makes the 3D presence of the scene much greater.
As the demo video shows, Sidewinder certainly adds a 3D effect to 360° video, but the results are still far from perfect with stretched pixels becoming glaringly obvious.
Adobe Sidewinder adds 3D depth to 360° video, but still needs some work on perfecting the images.Credit: Adobe
To learn more about these three sneak peeks as well as the other eight future features Adobe unveiled at Adobe MAX last night, check out its blog post on the event.
Source: Adobe
