Color Correction

Color Correction

May 19, 2013

This short article began with the rather dry title, "Tracking CDL Through Post." As I began to write, my thoughts started to meander into the obvious and maybe not so obvious ancillary aspects of this topic. I now feel the more gestalt title, "Color Correction", actually seems appropriate. And please forgive me if this post comes off as very "101".

I do a fair job of keeping up with the blogs, (RIP Google Reader, enter Feedly.) Among the many great sites out there on the topic I'm always reading about software and hardware tools, plug-ins, look building, and the technique of color correction but very little about why it's necessary in the first place.

So why do we color correct?

Forget building Looks for a moment. And by that I mean digitally crafting the visual qualities - color, saturation, and contrast - of a shot instead of doing it the old fashioned way - with optics, exposure, and photochemistry. At it's very root, color correction is about camera matching and shot matching within a scene so as not to take the viewer out of the moment with an abrupt change in visual continuity. And this, more than anything else is defined by color temperature.

A definition - Correlated Color Temperature (wikipedia):

The particular color of a white light source can be simplified into a correlated color temperature (CCT). The higher the CCT, the bluer the light appears. Sunlight at 5600K for example appears much bluer than tungsten light at 3200K. Unlike a chromaticity diagram, the Kelvin scale reduces the light source's color into one dimension. Thus, light sources of the same CCT may appear green or magenta in comparison with one another [1]. Fluorescent lights for example are typically very green in comparison with other types of lighting. However, some fluorescents are designed to have a high faithfulness to an ideal light, as measured by its color rendering index (CRI). This dimension, along lines of constant CCT, is sometimes measured in terms of green–magenta balance;[1] this dimension is sometimes referred to as "tint" or "CC".

533px-PlanckianLocus.png

Every camera sensor, every lens, in-front-of-the-lens filter, light source (most particularly the sun and sky!), and light modifier will produce or interpret Reference White (Chroma Free) in a slightly different way. In the case of lenses, something like Master Primes are remarkably well matched within the set whereas older glass like Zeiss Superspeed Mk III's, for example, will have a lot of color temperature and even contrast shift from lens to lens. This being the case, we can say there is a significant amount of color temperature offset to contend with between all of our light producing and image re-producing devices.

Here's a 50mm Ultra Prime on an Arri Alexa with camera white balance set at 3300 -3, lens iris at T2.8. Below it is an Angeniuex Optimo 24-290mm zoom lens @ 50mm put on the same camera with the same exposure and white balance.

RGAR311338.jpg
ultra-clean.jpg
optimo-clean.jpg
angeniuex_optimo_rental_seatles600x600.png

The Optimo Zoom lens (bottom image) is much warmer and greener than the prime. If these lenses were both working in the same setup, color correction instantly becomes necessary, lest one angle looks "correct" and the other either too warm or too cool in comparison.

All of these variables - optics, light sources, sensors, etc - and their inherently different color temperatures often add up to cameras that don't match and shots within the same scene that are offset from one another along the warm-cool and green-magenta axis.

In this era of high ISO cameras, color temperature offsets are most evident in heavy Neutral Density filters, often used to block as much as 8 stops. In my opinion, heavy ND's are the most destructive variable in contemporary digital imaging. Even with the best available filters such as the Schneider Platinum IRND's, we're still seeing a lot of color temperature offsetting with filters over 1.2. The problem is it seems that most Neutral Density filters (either conventional or with Infrared Cut) do not retard Red, Green, and Blue wavelengths of light in equal proportions. What we're left with after reducing a lot of stop with ND is more blue and green wavelength than red which is vital to the accurate reproduction of skin tones. If this part of the picture information has been greatly reduced, it can be very challenging to digitally push life and warmth back into the subject's skin without introducing a lot of noise and artifacting.

Here's the 50mm Ultra Prime again.

ultra-clean.jpg

And here with a Platinum IRND 1.2. The camera ISO, white balance and exposure are the same. To get the stop needed to compensate for the ND, the quantity of the light was increased on the chart by bringing it closer to not affect its color temperature by dimming or scrimming.

nd12.jpg

Comparing the two, they're really quite close. I've got to say, the Schneider Platinum's are the best I've found. With other sets of IRND's, you'll see significant color temp offset even at ND .3 but with these at ND 1.2, there is only a very slight shift to green. But this is still something that will need to be corrected.

Here's IRND 1.5. We're starting to get increasingly cool and green.

nd15.jpg

IRND 1.8

nd18.jpg

IRND 2.1

nd21.jpg

And for comparison, back to our original, filter-less image.

ultra-clean.jpg

After depriving the image of 7 stops of light with Neutral Density, we've unintentionally reduced some of our red channel picture information. At this point we can correct with camera white balance by swinging the camera to a warmer Kelvin and pulling out a little green. Or we can use digital color correction tools like LiveGrade at the time of photography or DaVinci Resolve in post production to match this shot with the scene. ND filters are but one variable among many when it comes to managing color temperature offsets spread across the camera and lighting.

Fortunately, there are numerous ways to deal with it.

In my opinion, these offsets can usually be solved most expediently with Camera White Balance (WB). Depending on the camera and how we're doing the recording, this WB setting is either "baked in" to the image or exists as metadata. In the case of the Arri Alexa, the orange-cyan (warm-cool) axis is represented in degrees of kelvin with green-magenta adjustable in "+" or "-" points of color correction.

alexa_WB.jpg

If you're working with the RED camera, the Redmote is great for wirelessly adjusting white balance when you need to.

redmote.png

Wireless remote operation of the Alexa is a desperately needed feature. The best we can do for now is the Arri RCU-4 better known as the "Assistant Panel".

rcu_4.jpg

This is a great little device that's chronically underutilized as it gives you full remote access to the camera unlike the Web Browser ethernet interface which is very limited. The RCU-4 is powered through its control cable which I've used successfully at lengths up to 150'. This device makes white balancing the Alexa incredibly fast and efficient as it no longer need be done at the side of the camera.

Not to get too obvious with this.. Moving on.

Another approach is to manage color temperature by putting color correction gel - CTB, CTO, CTS, Plus Green, Minus Green - on light sources in order to alter those with undesirable color temperatures to produce the correct, color accurate response. Color correction tools, digital or practical, do not necessarily apply to the creative use of color temperature. Having mixed color temperatures in the scene is an artistic decision and one that can have a very desirable effect as it builds color contrast and separation into the image. Mixed color temperatures in the scene will result in an ambient color temperature lying somewhere in between the coolest and warmest source. Typically in theses scenarios, a "Reference White", or chroma-free white can be found by putting the camera white balance somewhere around this ambient color temperature.

Identifying problematic light sources and gelling them correctly can be a very time and labor intensive process and one that doesn't happen on the set as often as it should so is usually left up to the digital toolset. There is now a whole host of affordable softwares that can be used on the set at the time of photography like LiveGrade or LinkColor or later in post production - such as Resolve, Scratch, Express Dailies, and countless others.

When we're talking about On-Set Color Correction, we're usually talking about ASC-CDL or Color Decision List. CDL is a very useful way to Pre-Grade or begin color correction at the time of the photography. This non-destructive color correction data is very trackable through post production and can be linked to its corresponsing camera media through metadata with an Avid ALE. When implemented successfully, the Pre-Grade can be recalled at the time of finishing and be used as a starting point for final color. In practice, this saves an enormous amount of time, energy, and consequently.. $$$.

Here's one way an ALE with the correct CDL information can be generated in Assimilate Scratch Lab:

In the top level of Scratch, here's our old friend the Chip Chart. Hooray!

scratch_top.jpg

We've applied the standard Alexa Log to Video 3DLUT to these shots and as you can see, the first one looks pretty good but the rest suffer from various degrees of Color Temperature Offsetting.

s1.jpg
s2.jpg
s3.jpg
s4.jpg

At this point, if we Pre-graded on the set, we could load the correct CDL for each shot and be ready to output dailies.

In the bottom lower left on the Matrix page, is the LOAD button. Click it to go to this dialog window:

load_cdl.jpg

Here CDL from the set can be applied on a shot by shot basis. Once everything is matching nicely it's time to embed this work into metadata that can easily be tracked and recalled at a later time.

CDL_Export1.jpg

Select +CDL and click "Export EDL/ALE"

cdl_ale.jpg

From the drop-down, select .ale, and then name your ALE something appropriate.

Now in Avid Media Composer, we're going to import this ALE to add ASC-CDL Slope, Offset, Power, and Sat (Gamma, Lift, Gain, and Saturation) values that will now be associated with their corresponding clips.

This post assumes a working knowledge of Media Composer. If you're not sure how to set up an Avid project, import media, make bins, and import an ALE, there are plenty of great tutorials out there.

Once you have the transcoded DNxHD media in the correct MediaFiles directory, import the ALE.

choose_columns.jpg

Click the "Hamburger" Icon in the lower left of the bin (I have no idea what this Selector tool is actually called but I've heard many an Assistant Editor refer to it as the Hamburger), and then select "Choose Columns".

bin_columns.jpg

Here we have the opportunity to select which columns show up in our bin. The ASC-CDL values are already embedded in the ALE we imported but it's a good idea to verify them which we can do at the bin level by turning on these columns. From the "Choose Column" drop-down, select ASC_SOP (Slope, Offset, Power) and ASC_SAT (Saturation).

asc_sop_sat.jpg

As you can see, all of the adjustments we made as CDL are now reflected in numeric values and are linked to their corresponding shot in the form of Avid metadata. ASC-CDL, while unfortunately limited in a lot of ways, really is a fairly univeral interchange for color correction data and can be implemented quite easily.

What we really need is a way to recall these ASC-CDL values from the ALE in a software like LiveGrade making this color correction data even more interchangeable.

Another possible workflow is to generate the dailies in Resolve using CDL from the set. Once that CDL corresponds with a shot in Resolve, that CDL can track with its correct shot all the way to finishing if the original Resolve project(s) is used.

What's the best approach? All of the above. The right tool for the right task and no two projects are alike. That's why a DIT is hired in the first place, to consider the criteria and then advise the best course of action. 

Update

on 2013-06-06 14:55 by Ben Cain

Just read this related article -

http://www.hdvideopro.com/technique/miscellaneous-technique/help-desk-getting-it-white-the-first-time.html?utm_medium=referral&utm_source=pulsenews&start=1

Content feels eerily familiar!

HD Monitor Calibration - White Balance and Color Bars

HD Monitor Calibration - White Balance and Color Bars

February 12, 2012

This post is in regards to HD Rec. 709 monitor calibration only. There are several issues relating to standard definition video and monitoring that do not apply to HD.

1. NTSC Setup, or 7.5 IRE (%) Black Level. Setup is for standard definition only. The black portion of HD test signals hit 0 IRE (%) on the waveform. 

2. Phase: There is no Phase control for digital HD monitoring. Only CHROMA (saturation) affects picture as Phase relating to monitoring is an analog issue only. 

COLOR BAR TEST SIGNALS:

Many cameras and recording decks generate color bars - either the HD SMPTE (Society of Motion Picture and Television Engineers) version, which is this:

SMPTE HD

SMPTE HD

Or the newer HD specific version, ARIB (Association of Radio Industries and Businesses):

ARIB

ARIB

Correct use of these test signals will help you properly set your HD monitor's Brightness (black level), Contrast (white level), and Chroma (color saturation level). The process of using either of these color fields is virtually identical. While color bars will help you to setup aspects of your monitor, they do nothing to reveal whether or not it's calibrated, meaning it's accurately reproducing colors and a neutral chroma-free gray scale. This is the most critical component of monitoring and is accomplished through a White Balance Adjustment.

Part 1: Monitor White Balance

When we are calibrating a HD monitor, we are adjusting it so that 100% white is reproduced as completely neutral and chroma free within the Rec. 709 color gamut

Rec. 709 gamut / color space

Rec. 709 is the standard color space for HD images. It specifies a white point at D65, 6500 degrees kelvin. If this white point is placed correctly, it should ensure that all colors and grayscale within the gamut are accurately reproduced. If it does not, then there are calibration issues that cannot be resolve through a white balance adjustment alone.

When we white balance a monitor we start at D65 and then adjust Red, Green, and Blue gains to push 100% into the correct target white point. As is exemplified in the graphic above, this is represented by a two dimensional chart with x and coordinates. For LCD's, CRT's, and other legacy displays the coordinates for white within Rec. 709 are x .313 y .329

These adjustments are made using a spectrophotometer or colorimeter aka "probe". The process of white balance adjustment with a probe is similar from monitor to monitor. Some can use a probe to do this process automatically whereas others must be done manually.

Abel Cine has a great article on how to use this hardware / software combination to White Balance your monitor >>>  

An overview of the process, first input a 100% white test signal into the monitor and then use the probe to objectively measure the screen. It will tell where this white image is hitting in the gamut by way of x and y coordinates. From here, RGB gains are adjusted until the probe verifies that white is hitting the correct coordinates, x .313 y .329. If you're using an OLED monitor, you will use different coordinates than x .313 y .329 and you may need to adjust Bias as well to compensate for chroma cast in the dark tones of the picture. This process is very similar to adjusting White Balance, just using 20% neutral gray instead of 100% white. 

The most inexpensive way to do a White Balance Adjustment on your monitor is with a free software from Sony used with the i1 Pro and i1 Pro 2 probes. These aren't the most accurate probes available but they are well priced and I've had very good results aligning and matching displays with them. 

Use the probe / software and adjust RGB Gains and Bias to hit the correct targets for both 100% White and 20% Gray. Color temperature is denoted by "x" and "y". Luminance level is "Y". 

100% White (Gains)

x .313

y .329

Y 100 (studio level)

20% Gray (Bias)

x .313

y .329

Y 2.7 (gamma 2.2)

The x and y points will always be the same for both Gain and Bias. The Y level for Bias will change with the gamma setting be it 2.2, 2.4, or 2.6. Consult your manufacturer!  

AN IMPORTANT NOTE ON MONITOR GAMMA:

Rec. 709 doesn't actually specify a gamma but the de facto standard is 2.2. The newer Rec. 1886 specs gamma at 2.4. This topic is beyond the scope of this post so I've written a separate article on it. Rec.ommendations for Display Gamma >>> For simplicities sake, this article assumes we are working at a gamma of 2.2

Once we're successfully white balanced and selected gamma, we can now use color bars to finish the calibration process.

Part 2: Setting Brightness, Contrast, and Chroma Level with Color Bars

AN ANALYSIS OF THE SMPTE HD COLOR FIELD:

The components of this test signal are 75% Contrast Color Bars (Yellow, Cyan, Green, Magenta, Red, Blue), 20% Blue Chip, 10% Purple Chip, 75% Contrast White Chip, 100% Contrast White Chip, 0% Black chips, and The Pluge. When using this test signal to set Brightness, Contrast, and Chroma, all you really need to concern yourself with are the 75% Color Bars, 100% White Chip, and Pluge. The 20% Blue Chip and 10% Purple Chip fall along the IQ Line on the Vectorscope for verification that the color information in the test signal is accurately centered on the scope. 

The Pluge will help you set your Brightness (Black Level). It consists of a -3.5% (IRE) chip on the left, 0% chip in the middle, and 3% chip on the right.

digital-smpte2012.jpg

Here are SMPTE Color Bars with lifted blacks so you can see the pluge better:

smpte169_bright.jpg

Here's the same signal's luma waveform. This helps to see where everything in the field is hitting in terms of level, particularly the pluge. 

smpte_waveform75_2012.jpg

And Vectorscope. You can see that each of the color bars lines up perfectly with thier targets indicating that these are pure, undiluted primary and secondary video colors. If this was a 100% contrast color field, the vectors would land perfectly in their little targets; R = Red, Mg = Magneta, B = Blue, Cy = Cyan, G = Green, Yl = Yellow. 

CAP20090328070812.jpeg

SETTING BRIGHTNESS, CONTRAST, AND COLOR WITH HD SMPTE BARS:

SMPTE HD

1. Set your gamma to 2.2 and White Balance to D65 (or User if you have done a custom White Balance Adjustment). Set your Brightness, Contrast, and Chroma to their default levels. If you have a display that can be custom white balanced, make sure that you're aligned before starting this. If you're working with a facility on a project, they can send a technician with a probe to you and he can do it for you. Or you can talk to you manufacturer and get a list of recommended probes for use with your display along with x,y (Color Temperature), and Y (Luminance) targets so you can do it yourself. Once you're there, send the HD SMPTE test signal to your monitor via HD-SDI. This is best done in a dark environment so if you're outside or in an unshielded location, try and keep as much ambient light and direct light off the display as you can. 

2. Everyone has their own way of doing this. I start with Contrast which is the most subjective. Looking at the 100% white chip, turn the contrast up until it visually stops getting any brighter. Now back it off a little bit. This will be different on every display and really the smart way to do is with a probe that reads Luminance level. 

3. By default, increasing Contrast will also somewhat raise the black level. Now use the pluge and set your Brightness so that the left (-3%) pluge chip disappears into the surrounding 0% black field. The right chip which reads 3.5% on the waveform should be just barely visible. 

4. Now check your contrast again. Is the 100% white chip still hitting peak white? If you need to adjust, make sure to go back and check your pluge again. By going back and forth between these 2 adjustments, you should be able to arrive at a satisfactory black and white level. 

5. Now check Chroma. Your monitor most likely has some sort of Blue Only feature. This is used to help you correctly set your color saturation level with Chroma. Turn it on and have a look. 

If it looks something like this, you're in good shape. 

correct.jpg

If you're looking at something like this, then the Chroma level is incorrect.

incorrect.jpeg

Adjust the Chroma level on the display until you're looking at solid, alternating bars of equal value. The larger top portion of each individual bar needs to blend into the smaller section beneath it. 

6. If you find that you have to make some adjustments to Chroma, this could up slightly changing your overall contrast so turn Blue Only off and check the pluge and 100% white chip again. By tweaking back and forth between all of these adjustments, you will be able to find the most accurate settings your monitor can produce. Please note that some monitors don't have Blue Only but can display in Monochrome. The Chroma calibration process with Monochrome is identical to Blue Only. 

At the end of the process you should be looking at something like this:

smpte169-correct.jpg

AN ANALYSIS OF THE ARIB COLOR FIELD:

This test signal has a greater variety of components than it's SMPTE relative. It contains the same 75% Contrast Color Bars, with the addition of neutral gray chips at various luma levels, and pluge with more steps (-2%, 2%, and 4%) that I suppose offer a bit more finesse for setting black level with Brightness. 

ARIB

Here's a handy diagram detailing what's what in the ARIB:

aribexplained.jpeg

Here's the luma waveform of the signal. Note the 0%-100% gradient that ramps through the middle of the field and the pluge at -2, 2, and 4%.

arib_wfm-1.jpeg

SETTING BRIGHTNESS, CONTRAST, AND COLOR WITH ARIB BARS:

ARIB

Though it looks radically different, on principle it's the same as the SMPTE. Follow the exact same steps outlined above when using this signal to arrive at correct Brightness, Contrast and Chroma levels. 

The biggest difference is with the pluge. When using this signal, the middle (2%) and right (4%) pluge chips should be barely visible with the the -2% chip blending into the surrounding 0% black field. 

When setting Chroma with Blue Only, this is what you should be looking at with the correct level:

arib-blue.jpeg

And when you're all done, this is what you should be looking at:

ARIB

SMPTE 100% COLOR FIELD:

100-new.jpg

Some recording decks will output these but very few cameras will. I don't think this is as useful a calibration signal as there's no pluge to help you set black level. It's good for checking saturation on displays or if for some reason you needed to check a 100% signal in a video system. This field contains the 3 primary video colors (Red, Green, and Blue) and 3 secondary colors (Yellow, Cyan, and Magenta) at 100% contrast along with a 0% Black Chip and 100% White Chip. 

On the vectorscope at Gain x2, you can see the colors hit their 100% targets spot on.

CAP20090328070637.jpeg

When looking at this color field with Blue Only and if your Chroma level is set correctly, you should be seeing something like this - bars of equal and alternating value:

100-new-blue.jpg

Great Explanation of Color Matrices

Great Explanation of Color Matrices

May 11, 2011

I don't usually re-post the content of others on this site but occassionally I come across a gem that's so in the nerd spirit of Negative Spaces that I feel obliged. Art Adams, author of the supremely useful technical blog, Stunning Good Looks, shares some thoughts on how a DSC labs Chroma du Monde chart works with your video camera's color matrix. Probably the most succinct and understandable explanation of video color response yet.