SEARCH

How-To Geek

Stop Believing TV’s Lies: The Real Truth About "Enhancing" Images

sshot-112

You’ve seen it over and over. The FBI uses their advanced technology to “enhance” a blurry image, and find a villain’s face in the worst possible footage. Well, How-To Geek is calling their bluff. Read on to see why.

It’s one of the most common tropes in television and movies, but is there any possibility a government agency could really have the technology to find faces where there are only blurry pixels? We’ll make the argument that not only is it impossible with current technology, but it is very unlikely to ever be a technology we’ll ever see. Stick around to see us put this trope under the lenses of science and technology, and prove it wrong once and for all.

How Imaging and Light Prove All Pictures are Limited

4775081581_852d17ab15_o

All imaging technologies, either digital or analog, all work roughly the same way. Let’s think about cameras for a moment. All cameras create some kind of image when light (particles we call photons) interact with some sort of image creating media. In digital cameras, it is a photoelectric sensor. In film cameras, it is a chemically treated, light sensitive strip of film.

sshot-109

It may surprise you to know that film-based cameras can capture more detail than even extremely high resolution digital cameras. But even with a film camera, only a limited amount of light can be recorded on the film. The same is true with any imaging device, be it a video recorder, a digital camera, or a flatbed scanner. And since any picture is taken in a finite period of time (usually fractions of a second, in the case of cameras), there is necessarily an upper limit to the detail of any captured image.

In digital imaging, that upper limit often has to do with the ceiling the camera or device has—the number of pixels the sensors inside the camera are capable of detecting, for instance. This is all about the limits of the device itself, and is slightly different than the problem of a finite amount of light reaching the media in the camera. Put simply, no camera, no matter how advanced, has an infinite capacity for resolution.

All Data is a Product of Other Data–Garbage In, Garbage Out

sshot-113

Computers are interesting machines, but they are not without their limitations. One of things most people misunderstand about computers is that they aren’t really capable of creating “new” information, they just sort of create “different” information. In mathematics, when one part of an equation is defendant on another part, it’s called a function. When Y = X+1, Y is a function of X. Whatever, X is, Y is directly correlated.

Computers operate in a similar manner. You can give a computer a huge text file of random letters and a dictionary, and tell it to arrange those limited set of letters into words from the dictionary. This works because the end product can be broken down into a function of the set of random letters, the words from the dictionary, and the directions to create one from another.

Imagine you’re doing algebra homework on your computer. You plug in a series of numbers into your “Y = X+1” equation. First, X = 1, so 1 + 1 = 2. But what would happen if you pushed the wrong keys, and input the wrong numbers? Would you still get the correct answer? If you meant to say X = 1, but typed X = 11, would the computer still give you the correct answer? The question is, of course, preposterous. This is the concept of “Garbage In, Garbage Out.” In other words, the wrong data will give the wrong answer.

Like our equation, “enhanced” images are a function of the original image. When you start with a blurry or pixelated image (or even a sharp clean one, for that matter) no amount of filters or computer magic can coax information out of a place where that the information simply doesn’t exist. Just as “1 + 11” will never result in “2,” a limited image will never result in the so-called “enhanced” version.

Why There’s No Function to Create Data from Nothing

You might ask the question, “Isn’t is possible to create a function that can add detail to a bad image?” Well, we’re not likely to create one anytime soon. Simply because we recognize an arrangement of pixels as a face does not mean that it’s an actual face. The face part is our perception of that data—we are in fact only looking at data! To take image data and transform it into “better” data is an impossibility. A function that creates something as specific as a human face from nonsense data would require actual knowledge of the end product—you would need to know the actual person’s face in order to “find” it in the blurry image, which sort of defeats the point of this imaginary technology anyway.

It may be possible to create some kind of face-like image from garbage image data, but this doesn’t mean that that product will be relevant. It might create a face that doesn’t actually look anything like the person that was actually there. It would more likely just create a mass of pixels that sort of just looks like a “different” version of what’s there. In TV logic, there’s a face locked behind that image, and the good guys are simply going to find a way to get to it. In reality, it’s only data—and any function that recreates the circumstances of a photo being shot already has that information within it.

How to Know The Government Secretly Isn’t Doing this Impossible Thing

hs-2004-04-a-print

Lots of money is being spent by government agencies like NASA to search the sky with satellite telescopes like the Hubble and the Kepler. These scopes and others on earth provide amazing, deep space digital photography of light, and also other wavelengths in the electromagnetic spectrum—things like radio and micro waves, and high frequency radiation, like gamma and x-rays. But all of these images are subject to the same limitations discussed earlier. They are snapshots in time. A limited imaging of X-rays is the same as a limited imaging of visible light. If images could be “enhanced,” deep space photography would be easy for anyone and everyone to do. If you can “enhance” an image by zooming in on a face in a crowd, why not go outside, take a snapshot of the sky, and “enhance” it to see the details on the ground of Pluto? If this was possible, an image—any image—could conceivably contain all the image data in the universe.

Is Actual Useful Image Enhancement Possible?

sshot-110

Simply because the way trope-riddled writing presents image enhancement is wrong, wrong, wrong, doesn’t mean that graphics programs aren’t useful tools for this sort of problem. As long as the information is actually within the image, some sort of “enhancement” might make it easier to see. Take, for instance, this dark, shadowed image, lightened to show detail within the shadow. This type of “enhancement” is real, and available to anyone with a computer. The difference is the data is already there—we’re just looking at it a different way. Our eyes can’t see (depending on your monitor) the detail in the face on the left. But the “enhanced” version on the right shows us plenty of detail in the shadow, giving us a better picture of his face.


So the FBI most likely doesn’t have magic Photoshop powers, and you can’t take pictures of the little green men living on Pluto with your funsaver. Don’t believe everything you see on TV!

Image Credits: Harrison Ford from Firewall used without permission, assumed fair use. Light Writing by BloomsEyeView, Creative Commons. Garbage by Editor B, Creative Commons. IMG1189b by HooverStreetStudios, Creative Commons.

Eric Z Goodnight is an Illustrator and Graphics Geek who hopes to make Photoshop more accessible to How-To Geek readers. When he’s not headbanging to heavy metal or geeking out over manga, he’s often off screen printing T-Shirts.

  • Published 12/18/14

RECOMMENDED POSTS

  • Ringhalg

    It's the same as trying to increase the quality of a video or image by up-scaling it to 1080p or better. The size will be much greater but the picture will be the same or worse.

  • James Barton
  • StevenTorrey

    The ability to enhance photos has been debunked since Antonioni's 1966 "Blowup".

    And not to engage in controversy with morons--the colorization of space photos is accomplished partly based on the science found in Wien's Law: the more energy, the more heat, the more intense electromagnetic waves--etc. Or to quote the actual principal: peak wavelength is inversely proportional to its temperature in Kelvin. (As one goes up, the other goes down.) Colors are not chosen to create pretty pictures.

  • Jeff

    This is one of my favorite videos regarding this:

  • Pradip Shah

    I have been into photography for over 45 years. "You can't get details where they don't exist." is the first rule. I have known this fact ever since but then you get tired of pointing out these stupidities on IMDB repeatedly. If the gullible viewers want to believe this bunkum who am I to stop them ? There are a whole lot of absurdities which are being aired related to computing, GPS tracking and imaging. The currently popular Scorpion is one of the biggest offenders in this department. But then as they say ignorance is bliss.

  • Martin Churms

    I would have thought that it might be possible to analyse a series of images, ie a video clip, by performing some sort of auto-correlation on the data recorded. My memory from 1960 is of being a 'probe monkey' for aircraft resonance tests and the recorded jittery vibration traces being digitised and then analysed to reveal the natural vibration frequencies and associated decay rates of a structure. Basically it pulled out statistically using autocorrelation what was common along a trace and eliminated the noise that was also present in the trace. What can the FBI, GCHQ, etc., do with video ?

Enter Your Email Here to Get Access for Free:

Go check your email!