Description image

How to Edit Your Amazing Magic Lantern 14-Bit RAW Video on the Worst Computer Ever

5d 5d3 magic lantern ml raw offline online workflow bmd blackmagic design davinci resolve adobe premiere tutorial card

When I started playing around with Magic Lantern RAW video, two things came to mind: First, a camera called the “5D” was once again the nucleus of a low-budget cinematographic revolution — this time thanks to the Magic Lantern team; Second, how was I ever going to be able to edit what I’d shot? I’ve learned a lot since then, and it turns out an offline/online, proxy-based workflow is not only possible, but powerful. Check out the process that I’ve been using to round-trip Magic Lantern RAW between Adobe Premiere CC and DaVinci Resolve Lite below.

Offline/Online Workflow for Magic Lantern RAW, Adobe Premiere, & DaVinci Resolve

As a brief recap: ‘offline’ refers to any time you are not working directly with original camera negatives, but instead on lower-quality duplicates, and ‘online’ refers to when you’re working with those originals. The reason the video is specific to Magic Lantern RAW vs. CinemaDNG in general has to do with the lack of metadata input (you could also use the tutorial for Blackmagic or Digital Bolex RAW if you wanted). This tutorial uses Apple Automator, Rarevision RAWMagic 1.0 beta (pre-App Store), DaVinci Resolve 9 Lite, and Adobe Premiere Pro CC:

This video is on our new YouTube channel, so be sure to head over there and subscribe for the latest filmmaking tutorials, BTS, and interviews.

Abridged Version

For those who need a Cliff’s Notes version, the two steps that are most important occur in Resolve at the 1) pre-proxy export and the 2) Premiere-to-Resolve (“CC SEND”) XML import stages. Here are highlighted crops of those steps (click for full resolution versions):

5d 5d3 magic lantern ml raw offline online workflow bmd blackmagic design davinci resolve adobe premiere tutorial important__crop1

5d 5d3 magic lantern ml raw offline online workflow bmd blackmagic design davinci resolve adobe premiere tutorial important__crop2

Additional Context

Certain tools such as raw2dng and Ginger HDR now offer a more direct route in many ways, but may not offer the strength, flexibility, and speed that this approach can provide. That’s the three-way tug-of-war. The most efficient post-production route depends on what you’re doing, and what you’re doing it with. That said, the benefits of this workflow are common enough to any offline/online process, basically amounting to the following:

  • Creatives working on less powerful machines may find it trying to work with CinemaDNG natively (though we know that situation is going to improve for Premiere in October with GPU acceleration). If real-time debayering is beyond the means of your machine, this process, or one like it, gives you the best of both worlds. It allows you to cut fluidly and save the full-res RAW for when you really want it (like during color correction).
  • Offline can also mean remote. Proxies can go where your full-res media may not be able to go: On a laptop, on a bus-powered drive, on Google Drive, on a plane. If your editor is not you and lives across the country, they only need the proxies to assemble a cut. Again, you still get to build your color grade from 14-bit uncompressed RAW either way.
  • You decide the compromise in your offline between speed and fidelity. Develop individual CDNGs to your heart’s content for your proxies, or batch decode into Rec. 709 and use that as a rough ‘one light’ look, workprint-style. If 709 in ProRes Proxy is too disheartening or depressing for you to look at while you cut, export your offline files in 422 HQ. It’s all up to you.
  • Bringing graded clips (as opposed to exporting one big file out of Resolve) back into your NLE makes it easy to fix specifics if anything needs a change — without having to re-export the whole project all over again.

Want to read a little more from an expert who works with the ‘grown-up’ version of workflows like this? Suits & Covert Affairs Online Editor Scott Freeman stopped by our comments section a few weeks ago. You can check out his thoughts here.

Notes

File Names vs. Folder Names (vs. Reel Names)

You may have noticed an inconsistency in some of my proxy file names in either the Premiere media browser or timeline — this inconsistency is illustrated below (click for full image):

5d 5d3 magic lantern ml raw offline online workflow bmd blackmagic design davinci resolve adobe premiere tutorial reels reely important__crop

Essentially, this happened because I was figuring this workflow out as I was shooting. Before I had the realization that I could rename .RAWs prior to using RAWMagic, I was renaming already-converted CinemaDNG folder names. This meant that Resolve named clips based on original ML RAW file names, but still created unique reel names for those clips. So it still works — I just find it less confusing to rename right at the original .RAW source. Speaking of which…

You Probably Don’t Have to Rename Anything

But I have been, and I still do. Why? If reel names are the only thing holding my offline/online connection together, I feel much better knowing I’ve insured myself against problematic duplicate names by implementing absolute control over what those reel names are. Your needs may find this step redundant, but ‘redundant’ is usually safer. In fact, I came across this post in the ML forums quite recently, from user Tony Mac:

I’m running into an issue when using multiple cameras shooting RAW and RawMagic to convert the files to CinemaDNG, I end up with files shot by different cameras with the same file name. For example I might have a clip named M30-1649 from two cameras. This causes issues when Resolve tires to relink the media from an XML.

Unlikely as it may be, this illustrates a real-world complication stemming from native ML-generated file names. The suggestions so far entail renaming files, and renaming .RAWs specifically (I think that’s the best solution Tony!)

References & Citations

Since I started making this video, I’ve seen references to this process pop up everywhere from Vimeo, to the ML forums, to nofilmschool comments. I didn’t devise or discover this workflow, but I did want to demonstrate my own little take on it. As I mention in the video, it would have taken considerably longer to figure out what worked for us (and what works at all) without the following material by Dave Thomas and Jesse Borkowski:

This tutorial by DP Hunter H. Richards we shared previously was also a big help — in fact, our grades here started with Hunter’s LUT. Here’s that video once more:

And, as always, super-special thanks to the Magic Lantern team and Thomas Worth/Rarevision.

I Want Your Workflow (and I want it Now :)

Obviously I like this workflow, and it works for me, but I’m biased. Whether your own Magic Lantern RAW workflow is similar to, or completely different from mine, I want to know what it is! The state of constant flux in which ML exists can be both exciting and frustrating (sometimes simultaneously), but with this comes ever-expanding flexibility in post production. Be sure to let us know your workflow below — apps, plugins, you name it. And thanks for watching!

Links:

COMMENT POLICY

We’re all here for the same reason: to better ourselves as writers, directors, cinematographers, producers, photographers... whatever our creative pursuit. Criticism is valuable as long as it is constructive, but personal attacks are grounds for deletion; you don't have to agree with us to learn something. We’re all here to help each other, so thank you for adding to the conversation!

Description image 77 COMMENTS

  • This is a great post! Definitely! If you can’t afford an actual editing rig that can process raw files or invested everything into a camera and lenses and a piece of crap iMac then yeah this work flow will very very very slowly allow you to cobble something out of all that raw data you have. In the professional world however, clients won’t accept, “Oh, I’m still rendering out a sequence for you, 38 more hours and you can see the first B-Roll scene.”

    • This is where I find the line between pros and amateurs gets drawn, which is working under a time crunch and being nimble enough to allow for client revisions.

      Clients don’t care that you have whiz bang graphics cards, or are behind the curve. They pay for results, not excuses.

      • If your client isn’t paying for it, don’t shoot in RAW formats. They complicate the process, and the client either won’t notice or won’t care about the difference in quality.

        If they’re paying you Texa$, then go ahead and add the RAW format. Chances are you can afford the amount of storage they take up and have a computer than can render them quicker.

        It’s not always about getting the absolute best product to your client. It’s getting the best product they paid you to deliver on time.

        • Non of my clients appreciates – or has appreciated – the RAW difference, in fact trying to explain it turned out to be a problem already; but on the bottom line it is me who can see the difference; the best I can do is just good enough for me, and if it is only me who appreciates it and I work a couple of extra hours (or days) to get it done I will – but hey’ that’s just me…

    • Good post,. Helpful unlike that dumb first comment.

  • Are they out of alpha (or beta) testing yet with the firmware for ML raw on the 5DIII?

    • Exactly my question. I would want to jump in and contribute but do not have the courage to put ML as I saved for years for the 5D3

  • Until the power of cheap computers catch up to the detail of cheap RAW cameras, proxy files will always be the best solution. Good post.

  • McBlakewich on 09.10.13 @ 11:43AM

    Great tutorial, Dave. Thanks!

  • Thank you!

  • Really great tutorial– Thank you!

    Is there any info out about whether shooting raw on the 5d miii will cause issues with the camera or sensor longterm?

    I just imagine shooting raw would put a lot of strain on the camera and perhaps prematurely age the camera. Looking to see if there is any evidence supporting or disproving this.

    • If you read past articles NoFilmSchool has posted, it seems to be suggested that shooting and recording the RAW data is actually less intensive on the internals than otherwise. You’re merely tapping into a stream that’s already being created. (IIRC)

  • vinceGortho on 09.10.13 @ 1:04PM

    Im ditching magic lantern raw.
    Worked on a shortfilm where the DP used it, and it held us up because its still prone to overheating.
    Actors complained. Gaffer complained the most.
    Someone else shot a short using the 7D shooting RAW, its on vimeo. They also complained about overheating, and had to resort to sitting the camera on ice packs.

    Canon raw seems passable for hobbiest. Maybe even as a quick use tool in your bag next to your real video camera. But as an A cam. Never.

    • >Actors complained.

      They always do, get used to it.

      • vinceGortho on 09.10.13 @ 4:49PM

        Thete is no reason a camera should hold up production, just because its 85 degrees outside.
        I like a happy crew. Its frustrating to ask actors to dig through personal and private places for performance, then tell them “sorry, my camera turned off again.”
        Their concerns were voiced very diplomatically.
        but no magic lantern RAW for me in the future.

        • I know exactly what you feel… Tried to shoot a short spot with my redMX and a 5DMKIII raw. Well. the camera performed really well, even on a hot day. But in post it was a nightmare compared to the simple/effective job on the R3D files.
          And also those pink dots with a ton of workarounds… None of them good at all. We ended up using Boris pixel fixer plugin fo AE.

          I cannot complain on my old MX. Solid fast compressed raw workflow is priceless on a tight schedule.

    • john jeffries on 09.10.13 @ 4:13PM

      Pretty much!
      I would never use a hacked camera for a serious project. And if you notice, most “films” made with ML are just typical vimeo trash of flowers and sunsets and cats. Nothing more than camera tests

      • vinceGortho on 09.10.13 @ 5:00PM

        Haha! Very true.
        I would say its a good practice tool for exploring RAW workflows- IF you already have a dslr.
        But never againa on my set.
        Shane hurlbut said he needed two 5d’s on set to cope with overheating and this was shooting .H264.

        • john jeffries on 09.11.13 @ 1:32AM

          I’ve never had a 5D overheat on me. 7D’s do all the time though. Had a scarlet shoot this weekend and it was rock solid, even in 100 degree weather. the new firmware does wonders

          • And the new dragon sensor… yeap… Oh my!

            R3D files play really well in resolve even with no rocket… I’m tryng to use cineform as a proxy or even a compressed Raw workflow. No way I’m storing DNG files!

          • john jeffries on 09.11.13 @ 12:09PM

            Yeah I don’t care much for DNG when the r3d compressed raw workflow is absolute genius and is so much more efficient.

    • Shooting on the Mark III, the camera did not overheat or stop recording once as long as we had card space. We were shooting in 90 degree plus heat for most of the shoot in the tutorial above, and again, did not have a single issue with the camera overheating.

      • vinceGortho on 09.10.13 @ 8:20PM

        Did our DP press record wrong?
        I wish your story was everyones story.
        Speaking for myself; ill avoid using it as an A cam for now on when sun is up or air circulation under controlled lighting is bad.

        Still a nice image.

        Hi, my name is VinceGortho and im a Magic Lantern RAW hack survivor.

        • Magic Lantern has temperature readings built in, you could confirm exactly what’s going on by checking the temp for both H.264 and RAW. Were you using the Mark III for that? Which cards?

          • VinceGortho on 09.11.13 @ 1:28AM

            Mark III was used. Wasn’t sure which cards.
            DP said hack was stable, then talked about how proud he was of it but never saw the cards.

            But these guys say the same thing about the 7D RAW using 1000x Komputer Bay 64gb cards: Over heating and Dropped frames. I really wanted the 7D to work out, because I prefer the APS-C size.

            https://vimeo.com/73835410

            “The first thing we noticed is that the 7D is still prone to over heating on long shoots. There were times we would stop and dump the footage solely because the camera needed to cool down and was dropping frames or producing too many corrupted frames. Ice packs were used several times. It was Texas in August, but were always in the shade and so this was disappointing to learn that raw recording doesn’t produce any less heat for the 7D. I haven’t made the switch over to .mlv, but I’ve read that it produces less corrupted frames, so I will be switching soon.”

      • As commonly known it tents to be rather hot around here in equatorial Africa – and the 5D2 does not overheat any more then it would when we shoot h.264, the CF cards get warmer but that is about it – also if it does overheat you’ll have less of an issue removing the sensor noise from RAW then you would from h264

        • VinceGortho on 09.11.13 @ 5:40AM

          I wish everyone else the best of luck. The image is stellar from canon RAW.
          Happy shooting.

    • So RAW is for hobbyists but you can call yourself a ‘pro’ and use h.264 coming from 5Ds and 7Ds on set? Just as a reminder, both are classified as semi-professional STILL cameras, therefore by no means (at least once adopting your point of view) professional cinema cameras… but then again I would never judge the degree of professionalism of anyone by simply looking at ones tools…

      • VinceGortho on 09.11.13 @ 1:45PM

        I’m Judging the limitation of the tool in a grueling environment.
        If I called myself a pro- not sure I did, but not in the way of “My skills are so good this cam couldn’t keep up with me.” Professional in terms of; everything needs to act in accordance of getting the job done. My experience with 5DIII Raw was not a good one.
        My opinion is, Canon Raw can finish a persons project with flying colors, or overheat on you.
        I would only touch it now If I already had a canon dslr, and want to explore RAW workflows for when I use a Red or blackmagic.

    • Are you using a battery grip? I’ve used many Canon cameras and most of them overheated on long hot days but most if not all that was gone when I bought battery grips. It seems that putting the batteries further away from the internals seems to do the trick and I’ve been shooting RAW all day with no issues.

      • VinceGortho on 09.12.13 @ 1:16AM

        Interesting.

        • Viktor de Hegyessy on 03.26.14 @ 11:51AM

          Of course it’s interesting…I would say even more than interesting!! That is the source of overheating for all canon DSLRs.. f.cking batteries! And yes the battery grip is the solution. Or have at least three batteries, that you can swap from time to time (before you see the overheating sign). When shooting RAW, the second source of heating problems are CF cards.. swap those more frequently as well..don’t wait untill a card fills up entirely. Anyway, if you watch out for the battery issue, you won’t have the CF card heating issue. Welcome

    • mikko löppönen on 09.12.13 @ 4:05AM

      I’ve NEVER had a 5dmarkIII overheat. What are you talking about?

    • The question is… When is a 5D a good option for an A camera ever?

      Great tool, great addition, but great A camera?

      Oh and fantastic tutorial. I hope people who are planning on heading into Davinci to grade appreciate how much time you will save them with that adding reel names to proxies.

      Cheers

  • I have a problem, following the same workflow, with pink dots on highlights and chromatic aberration in davinci, how can I solve it?

  • Great tutorial!!! Thanks a lot for sharing.

  • For those of u working in windows, the java application Action(s) works EXACTLY like Automator.

  • Thanks for the great tutorial! I just have one question for you. Where in this workflow would visual effects rest? Would it go between the proxy edit and the onlining in Resolve? I feel like it should go before color grading, but I am not sure where. Thanks in advance and keep up the good work!

    • Dave Kendricken on 09.13.13 @ 1:15PM

      I would say probably after the onlining so that your picture lock dictates your VFX needs, but if your pre-planning is exact enough you could conceivably do VFX work alongside the editing process. You’d just need better-than-proxy quality plates for the shots to be VFX’d. Let me know what you end up doing!

  • Hah, thanks for referencing me in the post, now I feel dumb! On a recent multi-cam shoot I already converted the .RAW files to Cinema DNGs and deleted the .RAW files. I guess I could go about individually renaming the sequence of DNG files in each folder with automator, but that sounds like a nightmare.

    I’ve renamed each Cinema DNG folder and then I’ll try the “Assist using reel names from the source clip file pathname” and hopefully it sorts it all out!

  • Hi there,
    Looks like a great workflow but what program’s would you recommend for a windows user?
    Many thanks

    • Dave Kendricken on 09.13.13 @ 1:10PM

      Hey Matt, Martin above states “the java application Action(s) works EXACTLY like Automator,” and Magic Lantern’s raw2dng application could conceivably take the place of RAWMagic. Cheers!

  • Wow. It’s just so simple. Yechhh.

    • Dave Kendricken on 09.19.13 @ 3:39AM

      Only if you don’t want to round trip. If you want a one-way street, watch Hunter’s video

  • Jakmen Dieta on 09.19.13 @ 8:51AM

    Man, i cant get Resolve 10 to round trip with Avid Media Composer

    Resolve 10 > Avid works
    Avid > Resolve 10

    did everything in your workflow
    anyone get Resolve & Avid Round trip to work ?

  • Great tutorial, very enlightening, thank you!

    Curious to know if your naming convention is something that Davinci requires for getting reel names. When I hit the Test button in the ‘Assist using reel names…’ dialogue I get ‘Reel number extraction failed!’

    But I didn’t use your exact naming convention, eg:
    Yours: 012_M….”
    Mine: “Reel_01-001…”

    Is the syntax important for the ‘reel names’ assist dialogue? (Actually, I’m not even sure what this step is all about as Davinci is brand new to me, so if you were inclined to explain that as well I would be most grateful.)

    Thanks again!

    • Dave Kendricken on 10.15.13 @ 9:54PM

      Hey Arin, thanks for the kind words. As far as I know, my naming convention is no more or less compatible than yours. I don’t have Resolve in front of me at the moment but my first instinct would be to skip the “Test” button and instead hit “Apply.” (It’s visible at the bottom-right of the Project Settings dialogue in my first “Cliff’s Notes” screencap). Let me know if that does the trick!

  • Hi, first of all thank you for your workflow it’s great, i only have one problem:

    when i finished my color correction/grading in resolve and i have rendered the xml roundtrip thing. When I select the xml file that i just created in premiere, it says: “This project contained a sequence that could not be opened. No sequence preview preset file or codec could be associated with this sequence type.” Does anybody know what happened and how can i fix it?

    Thanks

  • Steven Williams on 11.15.13 @ 12:06PM

    thank for this – but with resolve 10 when I make proxies and bring in the edited xml back in from Premiere, it does relink them, – ‘failed to link because ‘timecode extens do not mate any clip in media pool’

    any ideas? I have

  • Steven Williams on 11.17.13 @ 8:19AM

    Going mad trying to get this to work

    Followed the step to the letter – as you can see, resolve has reel names for DNGs, the Proxy File names are the same, and the XML Edit from Premiere is pointing to the correct file.

    Each and every time to do this, resolve gives me the ‘failed to link because time extends do not match’

    Dear Dave

    All the media – proxies, xmls are in the same folder on the same drive that is mapped in resolve.

    Don’t know what to do?

    Is anyone else in my position?

    https://www.dropbox.com/s/x92suhz9hwqyzqv/Screenshot%202013-11-17%2013.12.13.png

    • Have you managed to get this to work yet Steven? I’m having this exact same problem. Using PP CC 7.1.0

      • We’re having this issue too. We’ve read that Premiere CC is NOT listing any REEL/TAPE names in the exported XML, so DaVinci Resolve doesn’t know how to link it up correctly. A bug which supposedly Adobe know about, but please don’t take our word for it!

        Our only workaround at the moment is relinking each edit in the timeline of Resolve to its CinemaDNG counterpart in the media pool. VERY time-consuming!

        If anyone knows how to resolve this (no pun intended), or a workaround which doesn’t involve installing Final Cut Pro, then please let us know – and we’ll do the same if we hear anything.

        • I can confirm that the issue regarding the import of the XML list back in to Resolve comes from Premiere CC. I’ve just tried using the same workflow with Premiere CS6 and it worked fine.
          Ridiculous that we’re having issues like this as a result of more recent software!
          I’m now updating CC but who knows weather they will have fixed this issue…

  • Hi Steven,

    I’m having the same problem. Are you by any chance also using Premiere CC 7.1.0 because I’ve read somewhere that this updated premiere might be causing problems.

    • It wont roundtrip back to CS6, I get the problem below that a few people have mentioned

      “This project contained a sequence that could not be opened. No sequence preview preset file or codec could be associated with this sequence type.”

      Any Ideas on how to fix this?

  • Hey, I’m trying to bring my proxy premiere cut into Resolve and I’m getting import errors on all “Merged” clips. Can merged clips in premiere not import and link like the other master clips?

  • Hey Guys!

    Amazing post. Great to see these kinds of things online. Not sure if it’s possible, but is there a round trip solution similar to the above (that allows you to edit with a lower rez proxie file(s)) for the Adobe Creative Suite only? I’m sure a lot of us don’t have Davinci. (Unless I’m the only one. :3 )

    And does this workflow also work with the Mark II?

    Cheers!

  • Thanks for the awesome article Dave. I’m curious how you deal with spanned clips (when you record longer than a minute or so the files get broken up). How do you go about merging them with this workflow of yours?

    Thanks!

  • I think, well organized and Prepared footage is our ticket to successful edit and render.

    Use RAW 4 PRO to make proxies, then edit in any NLE on any weak computer (Win or Mac.) When done, online EDL back to DNGs and render. Easy!

    Workflow: http://raw4pro.com/support

  • i have 450 gigs of dngs im trying to make proxies out of.
    though it keeps saying that i will use %100 disk space creating the proxy files….even if i render to h.264 720 on the lowest setting? this isnt right? why would the proxies of that low resolution be larger than my DNG’s??

    any help would be great its driving me nuts!

  • If you have got an installation disk, insert it inside the
    drive of your computer and make the boot selection viz. This new update also comes with
    various improvements of features and services in Windows 7.
    Tip 9: You can install Windows 7 while offline but if you are
    connected to the internet at the time of installation,
    the program will automatically check for software
    updates.

  • In Vista the process is similar and your goal
    is “Service Pack 1″. Even with that, I’ve noticed extremely poor charge times, nothing like the OEM home or car chargers.
    Your choice depends on the level of encryption needed for yourself (or to bypass) and your budget.

LEAVE A COMMENT