Can the diffraction limit be overcome with superresolution?

Question

As the title says, can the diffraction limit be overcome with superresolution techniques? Or is this the absolute hard limit in optical photography without making special assumptions? If this is the hard limit, what is an illustration of why this is the case?

"Without making special assumptions" in this case means the techniques of superresolution microscopy - structured light, laser beams etc.

To illustrate the point: Can superresolution beyond the diffraction limit be achieved by taking multiple exposures from slightly different angles and positions and feeding them into [SR approach here]? Even with the added assumption of a diffraction-limited system (High resolution camera and lens)?

UPDATE Thank you for your answers. However it feels to me more like you explained to me what diffraction means rather than if it is possible to overcome the diffraction limit under reasonable assumptions. To clarify further: In a relatively controlled environment, where you can expect the subject to be stationary and the lens/aperture diffraction to be the limiting factor of resolution (as opposed to sensor resolution), do techniques exist to increase detail beyond this diffraction limit without the aforementioned "special assumptions"?

Answer 1

Can the diffraction limit be overcome with superresolution techniques?

Sort of, to a limited degree. Using sub-pixel shifting of the imaging sensor, in effect you are increasing each pixel size while keeping their spacing the same. Of course, it is not physically possible to build sensors where individual pixels are larger than their pitch (center-to-center spacing). But mathematically, this is basically what's happening.

That sounds great, but how does that overcome diffraction limits?

As Michael Clark stated in his answer, a camera system is diffraction limited when the size of the Airy disk (the blur) caused by diffraction becomes larger than the size of a digital camera's sensor pixels.

The size and nature of the Airy disk is not something you can overcome — it's a function of the wave-like behavior of light, the aperture size (usually assumed to be circular), and the wavelength of the particular light in question).

But if you can increase the size of the pixels while still packing the same number of pixels in the same area, you can "push back" the diffraction limit a bit farther. And that's what sub-pixel shifting of the image sensor does.

So it's not overcoming the diffraction limit per se, it's more like moving the goalposts a little bit.

The upper limit of sub-pixel shifting superresolution is an apparent twofold increase in resolution.

You don't get something for nothing. What's the tradeoff?

Well, as you mentioned, it requires a non-moving subject, that's one of the limits of applicability. As John stated in his answer, you are using the temporal-based certainty (i.e., there is no motion in the scene, so it exists independent of time) to take multiple images (which takes time, but who cares, you have plenty of it when the subject isn't moving) that help you increase your spatial information / knowledge about the scene.

Answer 2

All camera optics are plagued by twin demons of interference and diffraction. These yield stray light rays that comingle with the image forming rays. Diffraction is caused when light rays from the vista being imaged, just brush by the edge of the aperture stop. Some close passes are shadowed but not completely blocked. The ricochets comingle and degrade the image. Interference is due to the wave nature of light crossing paths and adding and canceling each other.

Well studied by Lord John Rayleigh, Astronomer Royal British 1842 ~ 1919 Nobel Prize physics 1904.

His calculations, remain valid. We are talking about the resolving power of a lens system. Following is a table for 589, about the center of our color spectrum.

Called the Rayleigh Criterion (to my knowledge, never exceeded)

f/1 1392 lines per mm

f/2 696 lines per mm

f/2.8 487 lines per mm

f/4 320 lines per mm

f/5.6 249 lines per mm

f/8 184 lines per mm

f/11 127 line per mm

f/16 87 lines per mm

f/22 63 lines per mm

f/32 44 lines per mm

Answer 3

Yes but you are trading one type of information for another - it doesn't break the laws of physics or information theory. You have to assume the object is stationary and you are trading signal to noise for resolution.

There are many possible approaches. One is simply blocking out the centre of your optical system and only using the edges. The central peak of the transfer function of this is narrower than for a circular aperture so your resolution is increased but you both have less signal received and have wider wings in the transfer function, both reducing signal to noise.

Answer 4

Several post-processing techniques that increase the resolution limits of a camera/lens system can be used to ameliorate the effects of diffraction. Stacking multiple images taken from slightly different positions as you suggest is one way. A tool such as Canon's Digital Lens Optimizer that uses very detailed lens profiles is another.

Diffraction is a lot like the edges of depth of field. The more we magnify an image the easier it is to see. Diffraction starts at apertures where only very high magnification will reveal any effects at all. As the aperture is closed down further the effects begin to be perceptible at lower and lower magnifications.

What we often refer to as the Diffraction Limited Aperture (DLA) for a specific digital sensor is the aperture at which the effects of diffraction are noticeable when the resulting image file is viewed at a magnification that yields 1-pixel in the image file equals 1-pixel on the monitor and those individual pixels are right at the limits of the viewer's perception to differentiate them. The DLA is the point at which the effects of diffraction are barely perceptible at such a magnification. This begins to occur when the size of the blur caused by diffraction becomes larger than the size of a digital camera's sensor pixels.

What we refer to as the Diffraction Cutoff Frequency requires a much narrower aperture setting than the DLA for a specific sensor (or film - the size of the grains in various films affects the DLA with film!).

For more on how the DLA is affected by the resolution limits of the recording medium, please see: Does sensor size impact the diffraction limit of a lens?