Watch: The Case for Hiring Robots as Film Colorists​

Colorist Dado Velentic reveals his AI-reliant method to perfect the art of color grading.

In addition to being a colorist himself, Dado Velentic has been working to develop tools to help other colorists (and really, all filmmakers) manage their finishing workflows. And at a recent talk at BSC Expo in the United Kingdom, Velentic has gone even further, sharing his current work that looks to bring AI and Machine Learning into the color suite.

Watch Velentic's entire talk below or read on for our takeaways.

One of the first things Velentic had to acknowledge was that most "auto-color" functions weren't very good. They rarely deliver on what they're designed to do: create an actual, proper match. However, there are algorithms that do a great job. Take "YouTube suggestions," for example, where the algorithm suggests a video for the user to watch next. YouTube can find eight videos out of trillions and recommend them to you. 

Credit: Colorlab

Realizing this, Velentic's team talked YouTube into sharing access to the algorithm, and they began building Joi, a color assistant. They built thousands of bots, giving them a wide variety of approaches to color grading, and then built another bot to evaluate the results of each creation. They kept the top 2% of bots from every round of testing and recycled the rest. 

The team's conclusion was that it is, in fact, possible to train bots to help with grading. They might not be able to create looks, of course, but in terms of matching one shot to another to help with workflow, the robots do a great job. Assigning a robot to be lead colorist will be trickier, since there aren't any ways to spend a few years as an assistant if a robot carries that task out more efficiently. 

The learning curve of the bots, being constantly corrected by humans guiding the process.Credit: Colorlab

AI is coming for jobs currently occupied by humans, and every industry is going to have to reckon with it. The film industry will not be immune. Velentic hopes to be back at BSC in 2019 showing off a working version of ColorLab Joi, built using the results of this machine-learning research.

For more info check out ColourLab.co    

Your Comment

2 Comments

Every digital art skill eventually becomes an Adobe plug in. : D

February 24, 2018 at 2:28AM, Edited February 24, 2:28AM

4
Reply
avatar
Jesse Yules
Director
396

Interesting concept but here's the rub as far as 'I' am concerned. I want a hammer, I buy it and use it until it's broken, lost, or stolen. Adobe went to SaS (software as a service) and suddenly I'm a renter instead of a buyer. No offense to people who want to become landlords but I avoid this scenario like the plague. My point? This guy is going to want to treat me like sheep, e.g. shear me yearly. So I'll wait for it to become a plug-in, instead. But he's spent all this time and effort creating it so he should be remunerated? Yes, he has, but charge me for it, don't rent it to me. Don't want to do it that way? Fine, I'll wait him out because if it's software, it'll be copied.

September 17, 2020 at 5:29AM, Edited September 17, 5:47AM

1
Reply