How-To Geek

Stop Believing TV’s Lies: The Real Truth About "Enhancing" Images


You’ve seen it over and over. The FBI uses their advanced technology to “enhance” a blurry image, and find a villain’s face in the worst possible footage. Well, How-To Geek is calling their bluff. Read on to see why.

It’s one of the most common tropes in television and movies, but is there any possibility a government agency could really have the technology to find faces where there are only blurry pixels? We’ll make the argument that not only is it impossible with current technology, but it is very unlikely to ever be a technology we’ll ever see. Stick around to see us put this trope under the lenses of science and technology, and prove it wrong once and for all.

How Imaging and Light Prove All Pictures are Limited


All imaging technologies, either digital or analog, all work roughly the same way. Let’s think about cameras for a moment. All cameras create some kind of image when light (particles we call photons) interact with some sort of image creating media. In digital cameras, it is a photoelectric sensor. In film cameras, it is a chemically treated, light sensitive strip of film.


It may surprise you to know that film-based cameras can capture more detail than even extremely high resolution digital cameras. But even with a film camera, only a limited amount of light can be recorded on the film. The same is true with any imaging device, be it a video recorder, a digital camera, or a flatbed scanner. And since any picture is taken in a finite period of time (usually fractions of a second, in the case of cameras), there is necessarily an upper limit to the detail of any captured image.

In digital imaging, that upper limit often has to do with the ceiling the camera or device has—the number of pixels the sensors inside the camera are capable of detecting, for instance. This is all about the limits of the device itself, and is slightly different than the problem of a finite amount of light reaching the media in the camera. Put simply, no camera, no matter how advanced, has an infinite capacity for resolution.

All Data is a Product of Other Data–Garbage In, Garbage Out


Computers are interesting machines, but they are not without their limitations. One of things most people misunderstand about computers is that they aren’t really capable of creating “new” information, they just sort of create “different” information. In mathematics, when one part of an equation is defendant on another part, it’s called a function. When Y = X+1, Y is a function of X. Whatever, X is, Y is directly correlated.

Computers operate in a similar manner. You can give a computer a huge text file of random letters and a dictionary, and tell it to arrange those limited set of letters into words from the dictionary. This works because the end product can be broken down into a function of the set of random letters, the words from the dictionary, and the directions to create one from another.

Imagine you’re doing algebra homework on your computer. You plug in a series of numbers into your “Y = X+1” equation. First, X = 1, so 1 + 1 = 2. But what would happen if you pushed the wrong keys, and input the wrong numbers? Would you still get the correct answer? If you meant to say X = 1, but typed X = 11, would the computer still give you the correct answer? The question is, of course, preposterous. This is the concept of “Garbage In, Garbage Out.” In other words, the wrong data will give the wrong answer.

Like our equation, “enhanced” images are a function of the original image. When you start with a blurry or pixelated image (or even a sharp clean one, for that matter) no amount of filters or computer magic can coax information out of a place where that the information simply doesn’t exist. Just as “1 + 11” will never result in “2,” a limited image will never result in the so-called “enhanced” version.

Why There’s No Function to Create Data from Nothing

You might ask the question, “Isn’t is possible to create a function that can add detail to a bad image?” Well, we’re not likely to create one anytime soon. Simply because we recognize an arrangement of pixels as a face does not mean that it’s an actual face. The face part is our perception of that data—we are in fact only looking at data! To take image data and transform it into “better” data is an impossibility. A function that creates something as specific as a human face from nonsense data would require actual knowledge of the end product—you would need to know the actual person’s face in order to “find” it in the blurry image, which sort of defeats the point of this imaginary technology anyway.

It may be possible to create some kind of face-like image from garbage image data, but this doesn’t mean that that product will be relevant. It might create a face that doesn’t actually look anything like the person that was actually there. It would more likely just create a mass of pixels that sort of just looks like a “different” version of what’s there. In TV logic, there’s a face locked behind that image, and the good guys are simply going to find a way to get to it. In reality, it’s only data—and any function that recreates the circumstances of a photo being shot already has that information within it.

How to Know The Government Secretly Isn’t Doing this Impossible Thing


Lots of money is being spent by government agencies like NASA to search the sky with satellite telescopes like the Hubble and the Kepler. These scopes and others on earth provide amazing, deep space digital photography of light, and also other wavelengths in the electromagnetic spectrum—things like radio and micro waves, and high frequency radiation, like gamma and x-rays. But all of these images are subject to the same limitations discussed earlier. They are snapshots in time. A limited imaging of X-rays is the same as a limited imaging of visible light. If images could be “enhanced,” deep space photography would be easy for anyone and everyone to do. If you can “enhance” an image by zooming in on a face in a crowd, why not go outside, take a snapshot of the sky, and “enhance” it to see the details on the ground of Pluto? If this was possible, an image—any image—could conceivably contain all the image data in the universe.

Is Actual Useful Image Enhancement Possible?


Simply because the way trope-riddled writing presents image enhancement is wrong, wrong, wrong, doesn’t mean that graphics programs aren’t useful tools for this sort of problem. As long as the information is actually within the image, some sort of “enhancement” might make it easier to see. Take, for instance, this dark, shadowed image, lightened to show detail within the shadow. This type of “enhancement” is real, and available to anyone with a computer. The difference is the data is already there—we’re just looking at it a different way. Our eyes can’t see (depending on your monitor) the detail in the face on the left. But the “enhanced” version on the right shows us plenty of detail in the shadow, giving us a better picture of his face.

So the FBI most likely doesn’t have magic Photoshop powers, and you can’t take pictures of the little green men living on Pluto with your funsaver. Don’t believe everything you see on TV!

Image Credits: Harrison Ford from Firewall used without permission, assumed fair use. Light Writing by BloomsEyeView, Creative Commons. Garbage by Editor B, Creative Commons. IMG1189b by HooverStreetStudios, Creative Commons.

Eric Z Goodnight is an Illustrator and Stetson-wearing wild man. During the day, he manages IT and product development for screenprinted apparel manufacturing; by night he creates geek art posters, writes JavaScript, and records weekly podcasts about comics.

  • Published 12/18/14
  • Ringhalg

    It's the same as trying to increase the quality of a video or image by up-scaling it to 1080p or better. The size will be much greater but the picture will be the same or worse.

  • James Barton
  • StevenTorrey

    The ability to enhance photos has been debunked since Antonioni's 1966 "Blowup".

    And not to engage in controversy with morons--the colorization of space photos is accomplished partly based on the science found in Wien's Law: the more energy, the more heat, the more intense electromagnetic waves--etc. Or to quote the actual principal: peak wavelength is inversely proportional to its temperature in Kelvin. (As one goes up, the other goes down.) Colors are not chosen to create pretty pictures.

  • Jeff

    This is one of my favorite videos regarding this:

  • Pradip Shah

    I have been into photography for over 45 years. "You can't get details where they don't exist." is the first rule. I have known this fact ever since but then you get tired of pointing out these stupidities on IMDB repeatedly. If the gullible viewers want to believe this bunkum who am I to stop them ? There are a whole lot of absurdities which are being aired related to computing, GPS tracking and imaging. The currently popular Scorpion is one of the biggest offenders in this department. But then as they say ignorance is bliss.

  • Martin Churms

    I would have thought that it might be possible to analyse a series of images, ie a video clip, by performing some sort of auto-correlation on the data recorded. My memory from 1960 is of being a 'probe monkey' for aircraft resonance tests and the recorded jittery vibration traces being digitised and then analysed to reveal the natural vibration frequencies and associated decay rates of a structure. Basically it pulled out statistically using autocorrelation what was common along a trace and eliminated the noise that was also present in the trace. What can the FBI, GCHQ, etc., do with video ?

  • Frank Trigg

    Photographs can and are made legible and non fuzzy by a process called Interpellation. It's been ued for over One hundred years

    If you have zoomed in until the photo becomes fuzzy you use interpolation to start placing similar pixils in between the real ones, For instance if after enlarging a photo of a face, and it becomes fuzzy you place lip colored or eye colored pixils nest to and in between real lip and eye pixils, can do it for the rest of the face. You may have do use several different algorithms for different kinds of photos, Interpolation has been around since the Civil War,although not near as sophisticated as now. Your eyes use interpolation all the time and we don't realize it, I figured the govt could do it during the Cuban Crisis. We almost had a nuclear war when the Russians started putting missiles in Cuba. Were we going to war based on those unintelligible pictures printed in the newspapers?. They were were labeled showing us which were the rockets and which were scaffolds etc, but I couldn't recognize anything. For Lords sake, ask around or punch it up before posting something so misleading. Since many people don't read the comments, I hope you post a correction.. By the way, photographers use it all the time. It is not a military secret..

  • Frank Trigg

    See the rest of the comments You might want to check them out

  • I thought it worth mentioning that a photo taken with a digital camera will have an embedded thumbnail image in the data. This image doesn't change regardless of how you alter the actual photo, in photoshop or most any other program that will blur or pixel the image - The thumbnail will remain intact of the original image. In most cases this thumbnail can be 'blown up' and can be used to uncover what the user has blurred or blacked out, etc. So If the photo has this data, and most do - it's nothing to use the thumbnail to restore the edited info back to something that can be used.

  • Gh Kl

    you are so wrong. there are techniques that can improve the resolution of images and videos. you are so uninformed and i think you should not write about things you don't have basic knowledge about.

More Articles You Might Like

Enter Your Email Here to Get Access for Free:

Go check your email!