July 20, 2015 at 11:54AM, Edited July 20, 11:55AM
NextStage Pro - Realtime Matchmoving with the Kinect
Hello No Film School!
For the past year I’ve been developing an application called NextStage that turns the Kinect for Windows and the Kinect for Xbox One into a realtime virtual production camera.
Some of the key features are:
- Realtime Camera Tracking
By tracking retroreflective markers, NextStage is capable of instantly and accurately tracking the Kinect’s position and rotation in 3D space.
- Instant Matchmoving
6DOF tracking lets users easily combine live action footage with virtual objects and sets, without the need for tedious frame-by-frame post processing.
- Depth-based Keying
Separate live action subjects from the background in realtime. Depth mattes let users place live action people or subjects on a virtual set without the need for green screen.
- Creative Effects
Depth mattes can be used as an instant, high quality garbage matte for green screen footage, or to quickly rotoscope actors and objects.
- HD Capture
Capture uncompressed RGBA footage in 720p with NextStage Lite, or sync tracking data to an external camera with NextStage Pro.
- Flexible Workflows
NextStage Pro lets users export 30hz tracking data to sync external cameras and devices at 24, 25 and 30 frames per second.
There is a free version called NextStage Lite that captures video using the Kinect’s onboard cameras. NextStage Pro allows users to export the tracking data to other applications like Blender and Maya.
More information can be found at:
I’ve been developing this application pretty much in a vacuum, but I’m very excited to finally get it out into the world. Please let me know if you have any questions, comments or concerns.