Video Art 'Unnamed Soundsculpture' Created with the Xbox Kinect

As Ryan proffered during its first week of release Microsoft's Xbox 360 peripheral, the Kinect, was destined to have an effect on how some story tellers would choose to tell and deliver there stories in the future and given its status as the 'fastest-selling device on record' there's an obvious audience for any compatible content you could push out to the device. However, perhaps of even more interest is the use of the Kinect as a creative tool as in Daniel Franke & Cedric Kiefer's Unnamed Soundsculpture:

The first step for the duo was to use three Kinects to capture the spacial and auditory data they'd work with later:

The basic idea of the project is built upon the consideration of creating a moving sculpture from the recorded motion data of a real person. For our work we asked a dancer to visualize a musical piece (Kreukeltape by Machinenfabriek) as closely as possible by movements of her body. She was recorded by three depth cameras (Kinect), in which the intersection of the images was later put together to a three-dimensional volume (3d point cloud), so we were able to use the collected data throughout the further process.

This data was exported as Krakatoa particle files which were then imported into 3ds max where after some additional rendering the 3d scene was completed, all of which you can more or less see in this making of video:

In case you're wondering, the virtual camera movement we see in Unnamed Soundsculpture isn't simply an arbitrary desire to show off the sandmanesque rendered dancer from a variety of angles. It too tapped into the Kinect data pool, specifically the sound, to drive its motion and work with the 22,000 point digital body to recreate a tangible dance performance.

With Microsoft performing a rather swift u-turn on their initial resistance to the Kinect being hacked, and in fact nowadays actively encouraging the community to push the hardware beyond its preconceived limits we're bound to see filmmakers using it in increasingly creative ways.

Video is no longer available:

Have you seen other good examples of Kinect filmmaking? Is the Kinect a camera narrative filmmakers could use?


Unnamed Soundsculpture - Onformative
Unnamed Soundsculpture - We Are Chopchop

Check-Out: Pro Video, Pro Audio, Lighting – Great Deals on Gear you made need !!

With any & every B&H purchase You will automatically be entered into the Monthly Gift Card Raffle.

Your Comment


I wish It had a narrative like this. Really creative and cool idea though

May 31, 2012 at 10:03AM, Edited September 4, 7:54AM


oops that video's audio was changed, here we go

May 31, 2012 at 10:04AM, Edited September 4, 7:54AM


Very nice.
Shame the number of comments is in direct proportion the technobabble about lens sharpness and cameras that nobody uses to any great effect.

June 1, 2012 at 12:42AM, Edited September 4, 7:54AM


June 1, 2012 at 12:56AM, Edited September 4, 7:54AM


Microsoft making a u-turn and encouraging hacking? Recognizing the virtues of openness? Astonishing.

June 1, 2012 at 4:49PM, Edited September 4, 7:54AM


Love that Pixies audio on the Kinect ad.

June 2, 2012 at 1:38PM, Edited September 4, 7:54AM


Wow, unnamed soundscape is great. Even their rough footage looks as good as many people's finished animations.

I like some of the details like how the sand settles on the ground in the pattern of the groves of the tiles.

June 7, 2012 at 3:12PM, Edited September 4, 7:54AM

Daniel Mimura

For most up-to-date information you have to pay a quick visit the web and
on world-wide-web I found this website as a finest web page for latest updates.

July 26, 2014 at 7:52PM, Edited September 4, 8:56AM