1
\$\begingroup\$

It is commonly stated that the spectral response of RGB colour imaging sensors (CIS) is chosen to match that of the human eye. While this is roughly true, when you examine this claim in detail it is only true to a very limited degree.

The human eye spectral response has significant overlap of red and green cones:- enter image description here

Typical colour imaging sensor spectral response looks as follows:- enter image description here

There are enormous differences between the CIS and the eye spectral responses. The red 50% point is ~515nm for the eye and 580nm for the CIS. The green 50% point is ~505nm for the eye and ~475nm for the CIS. The Blue 50% point is 475nm for the eye and 510nm for the CIS.

Why is there such large discrepancy between the two? Surely these sensors will require a large amount of colour crosstalk correction in the sensor electronics?

\$\endgroup\$
13
  • 1
    \$\begingroup\$ It is commonly stated that the spectral response of RGB colour imaging sensors (CIS) is chosen to match that of the human eye. Sources would be helpful because this seems more a strawman than part of an informed technical dialog. \$\endgroup\$ Commented Jan 5, 2021 at 19:43
  • \$\begingroup\$ I'm not sure where you got your "human" numbers, but the Short wavelength, Medium wavelength, and Long wavelength cones are most sensitive at 420nm, 534nm, and 564nm, respectively. I'm not sure your sensor examples are typical for many dedicated cameras, either. Even so, 590nm is a yellow-orange color, not red which is about 640nm. Many Sony sensors used in large sensor dedicated cameras have peak sensitivities around 460nm, 540nm, and 590nm, respectively. \$\endgroup\$
    – Michael C
    Commented Jan 5, 2021 at 19:47
  • 2
    \$\begingroup\$ Matching the eye is not important, our brains are what we ultimately see with and they have some pretty sophisticated signal processing. \$\endgroup\$ Commented Jan 5, 2021 at 19:48
  • 1
    \$\begingroup\$ @scottbb I'm not intentionally being uncharitable. It's just that I think the whole idea that our Long wavelength cones are most sensitive to "red", when they are not, and one-fourth of the color filters on our camera sensors are "red", when they are not, is what leads to a LOT of the confusion surrounding how our camera sensors mimic our retinas but our emissive color reproduction systems, which actually do use Red, Green, and Blue, do not. \$\endgroup\$
    – Michael C
    Commented Jan 5, 2021 at 20:23
  • 1
    \$\begingroup\$ I think the assumption that the "red" cones in our retinas = the "red" filters of our cameras' Bayer masks = the "red" subpixels used by our emissive displays is a source of GREAT confusion that there is no "crosstalk" between color channels in our eyes, camera sensors, and monitors. The fact is, there is crosstalk between channels in all three instances, even before compensation for varying light sources illuminating objects comes into play. Without "crosstalk", we would not perceive "colors" (which are purely a product of our perception - not a property of "light") at all! \$\endgroup\$
    – Michael C
    Commented Jan 6, 2021 at 8:16

4 Answers 4

6
\$\begingroup\$

This is a remarkably complex and interesting subject and no answer will be comprehensive.

The TL;DR result is that if the final picture looks acceptably like what you perceive, then it works.


Your eye spectra diagram seems a little compressed. You don't say where it came from. Here's one from Eye and Colors: Eye Spectrum

The color filters used for sensors will never match human spectra sensitivity. Not even humans match other humans. The question becomes whether or not you can manufacture and produce color filters that can be acceptably processed to produce a result that works. On top of the mismatch in spectra of the filters mentioned, sensors also use twice as many green sensors as a way to bump up green sensitivity to more closely match typical human color perception.

Could the color filters more closely match human spectra? Probably, but at what cost and benefit when a little software already handles the corrections?

On top of camera processing you also have the question of presentation.

Various display devices have their own spectra that also don't match the human eye. For example, the Samsung Quantum Dot vs Conventional TV: Samsung Quantum Dot vs Conventional TV

This too requires its own processing to produce results that are desired or acceptable.

For even more esoterica, you may want to delve into All the Colors We Cannot See, and Red-Green & Blue-Yellow: The Stunning Colors You Can't See

\$\endgroup\$
2
  • \$\begingroup\$ @ user10216038 -- A tip of the hat from Alan Marcus \$\endgroup\$ Commented Jan 5, 2021 at 19:27
  • 2
    \$\begingroup\$ + 1 ... buuuut The TL;DR result is that if the final picture looks acceptably like what you perceive, then it works. - this is an artistic photography site, and in the pursuit of art, anything goes. HDR doesn't look like what I see. Pushing the white balance to Tungsten while shooting outside doesn't look like what I see. But both are perfectly valid photos, even though they captured something that I cannot see. Same with infrared photography. In fact, perfect perceptual reproduction is very often not the goal of an artistic photo. \$\endgroup\$
    – OnBreak.
    Commented Jan 5, 2021 at 23:04
1
\$\begingroup\$

As you know, the human eye has light sensitive rod shaped cells that see light and shadow. These allow vision in dim light conditions however, this view will be monochromatic. The center area of the retina contains cone cells that are pigmented. These selectivity provide color vision. The majority of people have cone cells sensitive to red, green, and blue, the primary colors for mixing light sources.

The color vision we have is not fixed as to its sensitivity of colors. Our eyes have an amazing ability to make adjustments, in other words, an involuntary ability to shift hues based on conditions.

You can prove this for yourself. Procure some colored filters. Cellophane gift-wrap will do. Place a red filter over one eye. Stare about the room for a few minutes and then remove the filter. The filtered eye has changed its sensitivity (quire a lot), the un-filtered eye did not change. This involuntary color sensitivity change is eye independent. Try different color filters, and blink, right eye, left eye, you will be amazed.

OK, the camera, be it film or digital consists of a light sensitive material. The color sensitivity of film is adjusted using colored dyes called sensitizing dye. These alter the sensitive of film which in its natural state is only sensitive to violet and blue.

Digital cameras use colored filters over the light sensitive sights on the imaging chip. The color of the filters and the ratio of red, green, and blue filters, to each other is adjusted to force the chip to register colors in a similar way as does our eye/brain combination. Look up Bayer Matrix or Bayer Pattern on the web. The red, green, and blue filters over the light sensitive sites are arrange in a special pattern that modulates (modifies) the light that reached the photo receptors so that they mimic the human eye. Bayer is the Kodak engineer that figured this out.

\$\endgroup\$
-1
\$\begingroup\$

Surely these sensors will require a large amount of color crosstalk correction in the sensor electronics?

So do our eye/brain systems that correct for a wide variety of light sources.

Even though we often call them "red", "green", and "blue" cones, here are the actual colors to which our short wavelength (S-cones), medium wavelength (M-cones), and long wavelength cones (L-cones) are most sensitive:

enter image description here

Notice that our "red" L-cones are actually most sensitive to a lime green color between yellow and green and are less than 50% efficient at 640nm true "red" light. Our S-cones and M-cones aren't most sensitive to exactly "blue" and "green", either.

The Bayer masks over most of our color cameras' sensors aren't pure "red", "green", and "blue, either. The "blue" and "green" filters are pretty close, but the "red" filters are usually a shade of yellow-orange centered at around 590nm, rather than "red" light at 640nm.

enter image description here

Our emissive color reproduction systems (monitors, TVs, and other tri-color screens) do tend to emit colors that are closer to actual Red, Green, and Blue with the total area of their emissions centered at about 460, 525, and 640 nanometers. The specific colors can vary widely from one display to the next. Some four-color emissive displays also have a yellow channel at about 580nm, which is actually closer to the the 564nm peak sensitivity of our "red" cones than the 590-600nm peak of the "red" filters on our Bayer Masks or the 640nm light emitted by the 'Red' channel of our RGB color reproduction systems.

enter image description here

For more, please see these existing questions and answers here at Photography SE:

Why are Red, Green, and Blue the primary colors of light?
Why don't mainstream sensors use CYM filters instead of RGB?

This answer to 6500k calibrated monittor - what are the RGB values to represent a given monochromatic radiation of known wavelength? contains a lot of background information applicable to the question above, including a link to this excellent resource.

\$\endgroup\$
-1
\$\begingroup\$

Somewhat technical but here's a link that describes something in imaging science called the Luther criterion, which explains what camera sensors can not equal typical cone responses.

\$\endgroup\$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.