January 22, 2015

Where Science Meets Cinematography: Shooting Infrared with the ARRI Alexa XT B+W

A few months ago, I partook in an exciting opportunity extended to me by the kind folks at ARRI Rental New Jersey: spending a day at their rental facility shooting with the ARRI Alexa XT B+W camera, ARRI’s monochromatic camera capable of shooting in infrared, which is available exclusively from ARRI Rental. Not satisfied with simply shooting some dry camera tests, I brought my friend Zach Terry on board as a director, and, along with a small crew, we proceeded to shoot two short videos with the goal of exercising the camera in real-world situations and putting its features to the test. In this article, I will explain a little bit more about the science behind the camera, break down some of our technical choices, and discuss some of the more startling results, which you can see in the videos below.

So How Does It Work?

The Alexa XT B+W camera is like any other camera in the Alexa line in terms of its design, ergonomics, and overall build, with a few minor modifications: the Bayer mask, optical low-pass filter (OLPF) and IR block filters have all been removed from the front of the sensor. By removing the Bayer mask, the camera does not see nor record any type of color information, instead creating a monochromatic grayscale image. As a result of removing the Bayer filter, each pixel on the sensor array records the entire spectrum of visible light (as opposed to just the green, blue or red portions of the spectrum), which significantly increases the resolution of the image, extends the dynamic range of the camera to over 15 stops, and increases the native sensitivity of the sensor to 2000 ISO.

By removing the Bayer filter layer, each pixel on the sensor receives the entire spectrum of light, as opposed to just the red, green or blue portions of the spectrum, resulting in increased detail, sharpness and sensitivity.

The final piece of the puzzle is the IR block filter that is present in all digital cameras and is used to block out infrared light from hitting the sensor. In standard Monochrome mode on the Alexa XT B+W, this filter is still in place, limiting the camera’s sensitivity to the visible spectrum only and resulting in a “standard” (albeit much higher quality, sharper and more sensitive) black and white image -- the interior shots in the second video were filmed in this mode. However, what makes this camera truly unique is that this filter can be removed and replaced with a filter that blocks out all visible light, allowing only infrared light to penetrate through the filter and hit the sensor. This is the “Infrared” mode of the camera, which causes some of the more interesting visual anomalies that can be observed in the videos.

The light spectrum, highlighting the different ranges of infrared light and its relation to visible light.

I should note that this camera does not see the entire infrared spectrum, but rather a very narrow portion of it that is just outside of the visible light spectrum referred to as “Near Infrared”. Specifically, the camera is sensitive to wavelengths that are between 800 nanometers and 1,100 nanometers. To boil it down to basics, in infrared mode the camera will only see objects that reflect or emit infrared light. And our first major demonstration of this principle came when we turned the camera on for the first time on one of the rental benches inside the ARRI Rental facility

At first, we were confused as to why we were not seeing anything on the camera -- the monitor looked completely dark. Squinting, we could barely make out the contours of some of the other rental benches and features of the room. We quickly realized that this was simply infrared mode in action. The industrial fluorescent lighting that ARRI uses to illuminate its rental floor emits a very limited spectrum of light between 550 and 650 nanometers -- and no infrared light whatsoever. And for the camera in infrared mode, no infrared light is essentially the same as shooting in the dark with no light at all, which is why we couldn’t see anything on the monitors even though the room appeared very brightly lit to the naked eye. After putting together our equipment package, we took our camera outside into the infrared-soaked sunlight to really start putting things to the test.

What You Don't See is What You Get

The most immediately noticeable characteristic of the infrared footage is that it tosses all preconceived notions of color and tonality out the window. Objects that reflect a lot of infrared light, plants and certain synthetic fabrics in particular, such as cotton, show up on camera as hot white. As you can see from the photos below, our lead actor from the first video was wearing a dark-colored jacket, which in the video shows up as white. Leaves, grass and the roses from the first video all appear as a very light shade of white as well. Interestingly enough, other materials seem to be significantly less infrared-reflective, such as the actor’s denim pants, which show up as black in the infrared footage as well as in the reference photo.

Another interesting observation is that pigments and coloration don’t show up in camera at all. The apparent tonality of an object depends entirely on how much infrared light it reflects: for example, the roses from the first video are of all different colors, but because they all reflect an equal amount of infrared light, the roses all appear to be the same shade of bright white in camera. The same goes for the dress worn by the actress: The flower patterns printed onto the fabric of her dress do not register on camera at all.

Comparison between a frame grab from the video and a still photo taken on set. Notice the dark fabrics that show up as white on camera, the pattern on the dress, and the roses on the bottom right corner of the frame grab, as well as the leaves in the bushes behind the actors.

Eye pigmentation does not seem to register either. Though our actors in both videos had a variety of eye colors ranging from dark brown to light blue, in infrared their eyes all show up as the same uniform shade of deep grey, creating a very creepy “vampire eyes” effect. Hair undergoes a similar process, as demonstrated by the side-by-side comparison images of our 2nd AC, which you can see below. Human skin is also very infrared-reflective, and again, because discoloration and pigmentation don’t show up, various discolorations such as moles, freckles and more don’t show up in infrared at all, creating a sort of hyper-smooth, otherworldly texture to human skin.

Hair and eye tonality differences between the infrared image in camera and under observable, visible light.

Lighting and Exposure

For our exterior shots we predominantly relied on the natural sunlight, and utilized a single M18 HMI for a backlight or kicker. Though the HMI did not appear quite as bright in infrared as it looked to the naked eye, there was still enough infrared output in the HMI spectrum for it to register on camera. ND filters are incompatible with infrared filming, since the filters are designed to cut down visible light only, and do not affect infrared light at all -- as a result, the camera can see right through the ND. When held up in front of the camera, an ND filter appears to be just a clear pane of glass. The same effect can be observed with sunglasses, which in front of the infrared camera appear as empty frames. As a result, we had to rely mostly on ISO adjustment to control our exposure levels, and ended up shooting most of our exterior shots between ISO 160 and ISO 320. We also shot everything at 120fps, which provided us with a couple more stops with which we could get proper exposure without having to compromise depth of field.

An M18 HMI was used for backlight. Also notice the dancer’s black shirt, which shows up as white in the infrared image. Additionally, the pigmentation of her artificial hair dye does not show up in infrared, revealing her much lighter true hair tonality underneath.

Lenses

Since newer cinema lenses are designed with digital cameras in mind and often include infrared-reducing coatings, we decided to rely on vintage glass for these two videos that we know had much fewer coatings and would allow the maximum amount of infrared light to enter the lens and hit the sensor. We ended up shooting with Zeiss Super Speeds on the first video and Super Baltars on the second.

One funny side effect of shooting infrared was also one that we did not anticipate at all: lenses are calibrated for the visible spectrum only and are not designed to account for infrared light, and the huge differences in the wavelength and nature of infrared light meant that the distance markings on the lenses were completely off while shooting in infrared mode. My 1st AC had to rely entirely on the monitor and pulled focus by eye, since the marks on the lenses were often off by a matter of a few feet, sometimes more. Additionally, we employed a full white Pro Mist filter in front of the lens for the flashback sequences in the first video, in order to provide an ethereal, otherworldly look to the footage.

Conclusion

Like all Alexa XT models, the camera shoots ArriRaw directly to on-board Codex XR mags, which we then offloaded through a Codex Vault system and transcoded using a custom Log-C gamma space into ProRes 4444 2.8K files. (Unlike other Alexa XT models, though, the Alexa XT B+W does not have internal ProRes or DNxHD recording options; it can only record to ArriRaw.) All post-production was done entirely in ProRes. Unfortunately we simply did not have the resources to work with ArriRaw on this project.

The footage was graded in DaVinci Resolve by our wonderful colorist Erik Choquette, who really only had to adjust contrast levels since the images were monochromatic. A significant amount of correction had to be done sometimes even within an individual shot, as we were shooting under spotty cloud coverage. Because of the sensitivity of the chip and the sheer volume of infrared light, the presence of direct sun versus cloud coverage resulted in pretty significant exposure shifts, far more extreme than if we were shooting normally.

One final comparison, highlighting the irregularities in the infrared image.

All in all, it was a thrilling experience to put this incredible technology to the test, and every new visual curiosity sparked a little science lesson along the way as well -- trying to discern why the camera was reacting a certain way to some objects and another way to others, though there are still many textures and objects that we simply did not have the time to test on that day that I would love to shoot with this camera in the future. Overall, I think that infrared shooting provides a great opportunity to create some truly unique imagery, and while the technical and logistical limitations of the camera mean that you can’t shoot everything on it, I can certainly see it providing a very interesting and unique look to more stylized content such as commercials, music videos, or even a particularly pretentious dream sequence in a narrative film.

If you have any questions about the camera, the infrared technology, or anything that I neglected to cover, please don’t hesitate to chime in in the comments section or to reach out to me directly! My e-mail address can be found on my NFS profile page    

Special thanks to our lovely and talented performers in the videos – Elise Kibler, Taylor Myers, and Claudine Quadrat; our crew, Adrian Anaya (1st AC), Katelyn Rebelo (2nd AC) and Ben Sharif (Line Producer), our make-up artist Nichole Hernandez; and a huge thanks to everyone at ARRI Rental for making this day happen: Lynn ‘Gus’ Gustafson, Ryan Dwork, Cecilia Chien, Sachi Bahra, Brigitte Wehner, and Chris MacKarrell for providing technical consultation.

Oren recently wrapped principal photography on his second feature film, ‘No Letting Go’ featuring Alysia Reiner, Kathy Najimy, Richard Burgi and others, which is currently in post-production. Oren studied Film and Television Production at NYU’s prestigious Tisch School of the Arts, and has served as Director of Photography on numerous short films, commercials and music videos that have screened in film festivals around the world. In 2013, Oren was a finalist for the ARRI Volker Bahnemann Award for Cinematography. He has also served in a variety of camera crew positions on countless projects, both student and professional, for clients including Discovery Channel, A&E, The Economist, Weight Watchers, Republic Records, Target and MTV, and has interned on multiple feature films working with acclaimed Director of Photography Reed Morano, ASC.

Your Comment

19 Comments

I've tested IR filtering with an old GH1 I customized myself :
https://vimeo.com/76813235
It's a very interesting process, but it's mostly BW imagery. I tried several things with color images but they're way too off, and it's almost impossible to get the skin tones back.
And depending on the "array" of the IR nanometers you pick with your filter you can get very different results (I had a 730 if I remember correctly, unfortunately this camera was stolen from me...) but I didn't had such soft and transparent skins as they have on this one !

January 22, 2015 at 10:08AM

0
Reply

How did you customize it? I'm tempted to give it a shot.

January 23, 2015 at 12:44AM

4
Reply
Jacob Floyd
Writer / Videographer
1290

Well you can find online the instructions you need depending on the camera you have to modify, here for exemple :
http://www.lifepixel.com/tutorials/infrared-diy-tutorials
and I ordered the proper filter here : http://www.kolarivision.com/diyIRfilter.html
have fun !

January 23, 2015 at 3:51AM

3
Reply

This is fantastic! Really similar results in terms of the otherworldly effects on grass, eyes, skin tone, etc.

Actually, just yesterday somebody was asking me about what would happen if one were to remove the IR block and OLPF and put in a filter that blocks out visible light on a camera that still has a bayer pattern inside? It sounds like you've tried this out yourself - from what I've seen, the results are pretty wacky and the colors are just all over the place, but it definitely creates for a really unique look if you are willing to let go of normal skin color or normal any color, really. Would be very interesting to see some test footage of that...!

January 23, 2015 at 10:54AM

0
Reply
avatar
Oren Soffer
Director of Photography
1875

A couple of extra points in case it is of use to someone getting into this.
Yes Focus will be different in infa red but less widely known there are certain random lenses that are incapable of focusing with IR modified cameras. I lost a lot of time before i discovered this.
There are a few companies that will modify your standard DSLR to do this its not expensive but its permanent. I have had several done very happy with the results. I shoot both landscape and fashion with them. The effect on skin is very beautiful , the IR corrects many surface defects but i do tend to avoid eyes.
http://vimeo.com/9103464

January 22, 2015 at 11:03AM

3
Reply
Procter
98

A couple of extra points in case it is of use to someone getting into this.
Yes Focus will be different in infa red but less widely known there are certain random lenses that are incapable of focusing with IR modified cameras. I lost a lot of time before i discovered this.
There are a few companies that will modify your standard DSLR to do this its not expensive but its permanent. I have had several done very happy with the results. I shoot both landscape and fashion with them. The effect on skin is very beautiful , the IR corrects many surface defects but i do tend to avoid eyes up close.
http://vimeo.com/9103464

January 22, 2015 at 11:29AM

0
Reply
Procter
98

The effects of viewing images from the camera are surreal, especially on faces. Very interesting indeed, its a very unique way of shooting thats for sure.

January 22, 2015 at 4:19PM

7
Reply
Gvickie Xiong
Editor/Cinematographer/Director
782

I agree with you. Skintones are quite magnificent using infra-red.

January 23, 2015 at 10:52AM

0
Reply

Very interesting and i would love to shoot on black & white just because of this camera!

January 22, 2015 at 10:24PM, Edited January 22, 10:24PM

0
Reply
avatar
Wentworth Kelly
Director/DP/Colorist/Drone Op
2212

Now I wonder how people with darker skin tones would look? Ie will a black person look white? That would blow my mind O.O

January 23, 2015 at 3:24PM

0
Reply
avatar
Jumai Yusuf
Director, Producer
96

I had the same thought and asked the people at ARRI about it when I was there: they said that different skin tones generally maintain a similar shade, though there is still a sort of otherworldly translucency that becomes even more apparent with darker skin. I would definitely love to test that out in the future!

January 23, 2015 at 7:17PM

2
Reply
avatar
Oren Soffer
Director of Photography
1875

I actually asked about this when we were at ARRI! They told me that different skin tones maintain a similar shade in infrared, but there is a translucency that is very otherworldly and even more exaggerated in darker skin tones than lighter ones. That said, I would definitely love to test this out further at some point in the future!

January 24, 2015 at 2:28AM

4
Reply
avatar
Oren Soffer
Director of Photography
1875

I actually asked this same question when we were at ARRI! They told me that darker skin tones maintain generally the same shade in infrared, but do take on that otherworldly smoothness and translucency. I would definitely love to test this out with subjects of varying skin tones in the future!

January 26, 2015 at 10:29AM

0
Reply
avatar
Oren Soffer
Director of Photography
1875

Whoops! Took this response a few days to appear... guess I overdid it on the attempts after it didn't show up the first time ;)

January 28, 2015 at 8:41PM

0
Reply
avatar
Oren Soffer
Director of Photography
1875

Thanks for the info Oren! (For some reason I only noticed your reply now). This camera has inspired a lot of research into Infrared with my friends and I, and i'd love to get my hands on it to test it out. Also wouldn't mind asking you more questions seeing if my theories hold up!

May 24, 2015 at 2:11AM

1
Reply
avatar
Jumai Yusuf
Director, Producer
96

I wonder if some special contacts with built in UV filters might help eyes look a little more normal.

January 27, 2015 at 8:35PM

0
Reply
avatar
Daniel Mimura
DP, cam op, steadicam op
2226

Definitely something worth experimenting with! In fact, all sorts of different colored contacts might yield some interesting results.

January 28, 2015 at 8:24PM

3
Reply
avatar
Oren Soffer
Director of Photography
1875

Hi Oren,
really liked your short, nice work and interesting topic. I just finished my master degree by the end of last year, working on the technical issues of infrared-usage in cinema cameras. We did a experimental short as well. It was shot on Alexa B&W and RED epic IR. Have a look at the trailer below. Would be pleased to hear what you think of it!
https://vimeo.com/118289926

January 31, 2015 at 4:15PM

1
Reply

Daniel,

Fantastic! Thanks so much for sharing. This looks really great, I'd love to see the full film! You got very lucky with the weather - I only wish we had clear blue skies when we shot these videos, as they look really striking in infrared: a very very dark tone of gray that contrasts really interestingly with the hot white trees. Great stuff - certainly an interesting master's subject. What were some of the more interesting things you encountered in your studies?

February 3, 2015 at 2:09AM, Edited February 3, 2:09AM

2
Reply
avatar
Oren Soffer
Director of Photography
1875