Photographic retouching is nothing new, and it's as common as the digital technologies used to take the photos themselves. Retouching a video, however, is a bit trickier, and it usually requires more work to make a specific effect blend in with the rest of the image. Foton, Inc, a company from Japan, is working on technology that is achieving simply mind-blowing results with video that look as good as any Photoshopped image. Click through to check out these impressive clips.
This is what Foton had to say about the first video:
We developed special movie retouching techniques that won't damage a detail of material, and don't use "blur skill" for it that is why you feel more real. And also we work on 4K data without compressing 4K into HD. This model already had the natural beauty. However,we could improve it more to perform retouching,free transform, and color correction in the movie.
PetaPixel said this about the video:
It appears that the software is advanced enough to track with subjects’ faces as they moved around the frame, allowing for the edits to be consistent throughout the entire video without any blurring (look at how clear the skin is!). Although the new technique does away with frame-by-frame editing, Foton says it still spent 3-4 days creating the short proof-of-concept clip above.
This sort of manipulation is commonly done on movies and TV shows, but it usually takes a tremendous amount of time and work to do something like this on this sort of scale, and make it blend in perfectly. It's not often that you need to actually do this much to a video image, but if you could, and it could be done rather quickly and efficiently, why wouldn't you?
Here are a few more of their videos:
The other videos don't seem to be embeddable at the moment, but you can check out the rest on Foton's Vimeo page. You might be thinking that this isn't all impressive or that they do this all the time on movies, but most effects are not done at 4K, as the cost is just too great. It also seems that the technology they have can be made to work with lower resolutions, but I'm sure they have a custom tracker that works a lot better when there is more information and more detail.
The real test for this sort of thing will be to see it with a lot of motion. It's likely the tracker will have a difficult time if the scene changes drastically, but since we don't have any examples of that, we can't be sure. Can you do something like this in After Effects? Probably, but the amount of detail that is retained after retouching is impressive, and the retouches are blended seamlessly in a pretty impressive way.
What do you guys think? If the technology needs the extra pixels, does this make the case for 4K video? Have you done any retouching like this in your own work?
The family has spent their entire life on a farm, experiencing tranquility by day and horror at night, hiding from the monsters that come out in the dark. One day, Thomas doesn’t return after visiting his crush, Charlotte, at a nearby farm, so Paul leaves the safety of their home to find his son, while Joseph stays back to defend himself against the nightly monster attack.
Edited using Adobe Premiere Pro and Adobe After Effects, “Arcadian”, is a creepy dystopian feature you won’t want to miss, and we sat down with the film’s editor, Kristi Shimek, who shared a behind the scenes look into making this film. RLJE Films will release “Arcadian” exclusively in theaters on April 12.
How and where did you first learn to edit?
I feel like I was always drawn to editing. I enjoyed playing around with my parent’s video camera, and VCRs, and I learned tape to tape and live editing that way. I really didn’t get much experience cutting on NLEs until high school, when I took a media class and realized the power of being able to easily move things around. At university, I became serious about making editing my career and learned a lot more about the technical side as well as the theory of editing.
How do you begin a project/set up your workspace?
My workspace is pretty standard. I always have at least two computer monitors, a preview monitor, a mixer, speakers, and headphones. Sometimes I’m working on my own system, and other times I’m working with something the studio provides, so I try to keep it simple and effective so that I can work with whatever is on offer.
When I’m working on a project, I always talk in depth with my assistant about the easiest way for us to pass things back and forth and keep everything organized. I’m a neat freak when it comes to my project files and hard drives so that’s definitely important for me. I want to be able to move as quickly as possible when I’m in session, and knowing where everything is in the project is an essential part of that.
Tell us about a favorite scene or moment from this project and why it stands out to you.
I have many moments that I love in the film, but one of my favorites is when Thomas and Charlotte go to her tree at the edge of the boundary for the first time. The moment where they are approaching the tree was so fun for me to work with because we distilled what she was saying down and really considered what the most effective visuals would be for the emotion rather than just the information. Then we got into their lovely conversation — it was such a nice, quiet, and gentle moment where we could really take our time, get to know the two characters, and sit with the performances.
Similarly, I love the moment between Paul and Joseph in Joseph’s workshop, where they’re connecting on an emotional level as father and son. This was a scene that we reworked many times to get it exactly right, and what we landed on tells us so much about the characters through expression rather than words. These types of moments are so fun to cut because they really are the heart of the film, and they take a lot of thought and a delicate touch.
What were some specific post-production challenges you faced that were unique to your project? How did you go about solving them?
We needed a lot of technical flexibility on this project. First, we were working with full frame 3:2 footage with a 2.35 sequence as a wrapper. Since the files were so large, we needed to be able to manipulate them a lot in sequence to get exactly what we wanted out of each frame and moment. Premiere Pro is perfect for that because it allows you to easily manipulate the image in sequence — from resizes, to stabilizing, to camera shake, etc.
Ben, the director, and I also worked very closely together, both editorially and with visual effects. He is Premiere Pro and After Effects based, so it was essential for us to work on the platform that would work best for him.
What Adobe tools did you use on this project, and why did you originally choose them?
I cut in Premiere Pro, and then we used After Effects for temp and final visual effects. I would say it was mostly for the flexibility and also the option that the Adobe suite has to roundtrip from Premiere Pro to After Effects and back. Our workflow was really integrated between all of our teams, and when you’re working so specifically and heavily with the footage, it becomes a necessity.
We used Frame.io for notes and reviews on visual effects, as well as some editorial pass reviews. It’s so easy to have the time-coded notes referenced, respond to them within the program, and have the entire team be able to access them as soon as they’re available. I think it makes for much more open communication between the various teams as well.
If you could share one tip about Premiere Pro, what would it be?
Take advantage of the flexibility and the way Premiere Pro is able to playback layer-heavy sequences. Also, take advantage of the tools for temp visual effects like matting and masking, temp color and temp sound to give your project the look and feel that you and the director are going for, and bring it as close to the final product as possible.
The edit is the template of the movie for the rest of the team and is the best way to get the vision across for all of the teams that come after the edit — mixers, final color, VFX teams, etc. — so take advantage of what those tools have to offer to capture every aspect of that vision.
Image Source: RLJE Films
Who is your creative inspiration and why?
Walter Murch has been a huge creative inspiration and influence for me. His books opened my eyes on how to communicate my editorial ideas and how to take the fundamental ideas of editing and build upon them with theories of my own. As an editor, it’s very liberating once you have the language to explain your decisions. His editorial work is just as inspiring.
Murch focuses so much on the emotion of every frame and the connection between shots, and that is something I always try to consider with every cut. Every single shot and edit has meaning, and I want that to be felt in my edits as well.
What’s the toughest thing you’ve had to face in your career and how did you overcome it? What advice do you have for aspiring filmmakers or content creators?
I think one of the toughest things any editor has to face is that we are constantly getting to know new artists, teams, and creatives, and there is always a learning curve when you’re working through each new director’s unique vision. There are also different dynamics between various directors and producers, and a big part of the job is working with a lot of different personalities.
To that end, I would say to any up and coming artists to keep an open mind about notes or critiques received, even if you don’t think it will work. You never know what inspiration can come from trying something, and it builds trust and respect between you and your team. Everyone should feel safe expressing ideas in the edit room, and it is our job as editors to take those ideas and bring the story to fruition through whatever inspiration is found as a team.
Share a photo of where you work. What’s your favorite thing about your workspace and why?
I like to keep a few little things on my desk to remind me to have fun in the edit room. It can be stressful at times, and when you can just take a little glance at something that brings you joy, it brings a moment of relief. I also usually have at least a mug (for coffee or tea) and a water glass, and sometimes a soda as well — I don’t want to get dehydrated in the edit room!