Shoot features, commercials and docs for over 15 years.
They aren't 100 percent accurate. But do yourself a favor and enter a film into a number of festivals. The trends you'll see in your analytics is beyond suspicion and indicative of FF industry wide scam.
I've looked at the analytics on my Vimeo pro for my submissions. The Bad Apples far out number the good. The level is of scandalous proportions. After accounting for the thousands of submissions the scam is easily in the millions. It will bust sooner or later. I think WAB and Freeway or a new submission platform should offer services that track the viewing habits of screeners. Which ever one does it first will get support of filmmakers. But don't expect much from Film Freeway. My film was invited to an Academy Eligible FF in NYC that was poorly run. After giving it the reviews it deserved, Freeway, still displays their reviews as five star. In short, WAB and Freeway are in the business of generating as many fees as possible. It's not in their interest to be anything other than complicit in this scam.
NFS should run a deeper investigative piece on FF's as whole. I've done a similar examination of my Vimeo analytics and concluded that the number of FF's that don't look at your film or partially is scandalous and fraud on huge scale. Considering the thousands of submissions, the amounts of fraud is quite possibly in the millions. Short films by virtue of their huge numbers provide the grist for the submission fee mills. This could make an interesting subject for a documentary.
Thanks for this test. Some here say it's invalid as the Red was rated at 800 instead of 1250. I have to disagree. Most of the scenes were low key scenes, especially at the beginning. In this case, half a stop over, should benefit from the increased floor and reduced noise for the many night scenes. Though you may lose some color depth on the key side of white skin. Overall, to me the helium is not the breakthrough it's being touted as. It still has less depth to the skin tones than the Arri. I find the mini just has a more nuanced and natural tonal range.
All this said, I'd love to see just a simple A/B test with the Red at 1250 and the Alexa at 800. Just a key, a color chart and a hot highlight. I know doing tests right takes time and allows for few mistakes. So if you do go back to the drawing board, go simple and just give us native ISO +/- 1,2,3 stops in under tungsten then daylight.
While, I still suspect the Arri will produce a more detailed and richer image, it's also worth noting other aspects of an Arri vs Red test, such as usability. I personally find the Arri a piece of cake with its Fisher Price knobs, far less complicated than Red's menu set. Also, there's the built in ND's.
They also lost me at 500 NITs and Windows 10.
It's a non starter. If you're spending over 30K on a camera package, why not just get Red SSD's and a Red Touchscreen. You're going to need the touch screen anyway. Seems pointless to add an extra box to save a few bucks on SSD's. Also, if this SSD is internal and non-swappable, no one is going to buy it.