We've relaunched as a full community! Get the scoop:

May 31, 2012

Video Art 'Unnamed Soundsculpture' Created with the Xbox Kinect

As Ryan proffered during its first week of release Microsoft's Xbox 360 peripheral, the Kinect, was destined to have an effect on how some story tellers would choose to tell and deliver there stories in the future and given its status as the 'fastest-selling device on record' there's an obvious audience for any compatible content you could push out to the device. However, perhaps of even more interest is the use of the Kinect as a creative tool as in Daniel Franke & Cedric Kiefer's Unnamed Soundsculpture:

The first step for the duo was to use three Kinects to capture the spacial and auditory data they'd work with later:

The basic idea of the project is built upon the consideration of creating a moving sculpture from the recorded motion data of a real person. For our work we asked a dancer to visualize a musical piece (Kreukeltape by Machinenfabriek) as closely as possible by movements of her body. She was recorded by three depth cameras (Kinect), in which the intersection of the images was later put together to a three-dimensional volume (3d point cloud), so we were able to use the collected data throughout the further process.

This data was exported as Krakatoa particle files which were then imported into 3ds max where after some additional rendering the 3d scene was completed, all of which you can more or less see in this making of video:

In case you're wondering, the virtual camera movement we see in Unnamed Soundsculpture isn't simply an arbitrary desire to show off the sandmanesque rendered dancer from a variety of angles. It too tapped into the Kinect data pool, specifically the sound, to drive its motion and work with the 22,000 point digital body to recreate a tangible dance performance.

With Microsoft performing a rather swift u-turn on their initial resistance to the Kinect being hacked, and in fact nowadays actively encouraging the community to push the hardware beyond its preconceived limits we're bound to see filmmakers using it in increasingly creative ways.

https://www.youtube.com/watch?v=T_QLguHvACs

Have you seen other good examples of Kinect filmmaking? Is the Kinect a camera narrative filmmakers could use?

Links:

Unnamed Soundsculpture - Onformative
Unnamed Soundsculpture - We Are Chopchop

Your Comment

8 Comments

I wish It had a narrative like this. Really creative and cool idea though

http://www.youtube.com/watch?v=FRHiWQdbHYg

May 31, 2012

0
Reply
mike

oops that video's audio was changed, here we go

http://www.youtube.com/watch?v=Zt89tGaAj5o

May 31, 2012

0
Reply
mike

Very nice.
Shame the number of comments is in direct proportion the technobabble about lens sharpness and cameras that nobody uses to any great effect.

June 1, 2012

0
Reply
altavistalives

June 1, 2012

0
Reply
Tyler

Microsoft making a u-turn and encouraging hacking? Recognizing the virtues of openness? Astonishing.

June 1, 2012

0
Reply
Noel

Love that Pixies audio on the Kinect ad.

June 2, 2012

0
Reply
ty

Wow, unnamed soundscape is great. Even their rough footage looks as good as many people's finished animations.

I like some of the details like how the sand settles on the ground in the pattern of the groves of the tiles.

June 7, 2012

0
Reply
Daniel Mimura

For most up-to-date information you have to pay a quick visit the web and
on world-wide-web I found this website as a finest web page for latest updates.

July 26, 2014

0
Reply