Remix, Isolate, and 'Photoshop' Audio with Celemony's Melodyne & Sony's SpectraLayers

Anyone who's ever learned the basics of sound manipulation in a waveform editor, such as Audacity, knows how difficult it is to separate sounds from a mixed-down recording. I grew up with Sound Forge back when it was still owned by Sonic Foundry, and quickly came to understand how impractical it can be to isolate a clean vocal track from, say, a CD rip. A company called Celemony and their audio editing platform Melodyne is now making it incredibly fast, easy, and intuitive to do just that -- and much more, like autotuning those isolated vocals for remixing. Meanwhile, Sony is likewise doing the "impossible" with its impressive frequency editor/clean-up tool SpectraLayers.

In the specific case of stripping the vocals off a mixed down track to create an instrumental (or the opposite, discarding everything but the vocals themselves), there are several workarounds and methods for doing so. That said, Celemony's Melodyne makes this process visually intuitive -- and rather powerfully automated -- in preparation for further creative manipulation down the line, because it's specifically engineered to do so. This news comes to us from RedShark, including the following demonstration/tutorial:

The phrase "blobs" is certainly not in the traditional lexicon of audio -- nor sound at large, for that matter -- but in a strongly unique interface such as this, fresh terminology must follow. As both a commenter and the article's writer (Managing Editor David Shapton) over at RedShark mentioned in the comments of the original post, Melodyne isn't the first (or only, at least) piece of software to break mixes down in previously difficult-to-achieve ways. Other offerings such as Sony's SpectraLayers basically puts the power of Photoshop's toolset to a multi-layerable spectrogram view of a mixed-down track, except instead of visually manipulating something visual, SpectraLayers allows for visually managing the manipulation of something auditory:

On top of going over some pretty solid basics of sound and audio -- such as phase cancellation, which the above workarounds use more simplistically to do something similarly to, though with less control than, SpectraLayers -- this video is pretty easy to get excited about. Celemony's software is more dedicated to facilitating 'autotune'-esque control via isolation, but both of these products spell a bright future for audio production (not just for DJs). The possibilities of cleaning up a dual-system production track, which more often than not is being recorded by one microphone as a single mono channel, is very good news for filmmakers, too.

Again, tools for remixing and noise clean-up have existed forever, but never with this level of fine-tunable control. The Photoshop analogy rings strangely true, I feel, given the importance of the visual gamma and 'level multiplier' controls to SpectraLayers' efficiency. Why not shift the "contrast" or force "choke points" of a spectrogram plot to for tracing, and to work more easily with encoded material the way you can in Photoshop? Well, thanks to apps like SpectraLayers -- and from a bit of a different angle of attack, Celemony's Melodyne -- you can.

What audio clean-up (or mash-up) experiences have you had in which you really could have used a tool like this? What are the implications of technologies like this on your workflow as a filmmaker?

Links:

• Celemony Melodyne
• Sony SpectraLayers Pro

[via RedShark News]