The Incredibly Detailed Art of Benchmarking the Canon 5D Mark III

Illustration for article titled The Incredibly Detailed Art of Benchmarking the Canon 5D Mark III

Every time a camera comes out, nerds keep a close watch on DxO Labs to see how the image sensor will measure up to others in the camera benchmarker's battery of tests. DxO just released its ratings for the most anticipated camera in years: The Canon EOS 5D Mark III. CNET was there to document the whole process.


Given how much people seem to love the 23-megapixel Canon EOS 5D Mark III, it's surprising that it didn't score very well on DxO's scale. It barely beat out its predecessor, and it was absolutely demolished by the excellent 36-megapixel Nikon D800. In fact, DxO found the 5D MKIII's low-light performance—its hallmark—to be pretty paltry in comparison to its rival. In our tests of the two cameras, we saw advantages to both, but would never have chosen one so definitively over the other.

The reason for the ratings has a lot to do with how DXO Labs tests cameras. As CNET points out, it's a decidedly mathematical approach. DxO Labs is an imaging company, which designs image processing technology. To DxO, cameras and images can be fully understood in ones and zeros as measured with ultra-scientific tests. Take, for example, the company's perspective on the ongoing megapixel debate. We've argued for years, as many people do, that megapixels—as a measure of image resolution—aren't nearly as important as camera's ability to capture light. More megapixels generally hinders your ability to do so.

Not so, says DxO's Frederic Guichard:

"Everybody says there is no need for more pixels, and we should reduce the number to a reasonable number so the quality will improve," Guichard said. However, DxO's aggregate measurements tell a different story: "If we look at the cameras, there are more and more pixels, and the quality is increasing in the meantime."

And Guichard said dynamic range, which measures how well a camera can record details in both dark shadows and bright highlights, has steadily improved, too: "Manufacturers have made enormous strides in handling ever-smaller pixel sizes."


It's true, as digital imaging has gotten better and better, cameras can handle more and more pixels without losing quality. But it remains an open question whether DxO's approach can tell the whole story of a camera. There's lots to be learned by actually using them in the real world.

The whole CNET feature has tons of interesting camera geekery for those inclined. Check it out. [CNET]




My thoughts : We're in the year 2012. I think pretty much any camera coming out now is more than excellent for anyone.... when using said cameras for personal use; be it for art or just to capture all their important moments.

So... the pro's will continue to use what they know is necessary for their trades.

For everyone else : Quit fighting or arguing or manifesting your adoration for one brand or another. Everything that exists is benchmarked because it must, you; don't listen or judge; just enjoy it. Pick out a camera for the looks, for how it feels in your hand, for the inspiration it may bring you if photography is important to you. For those who just take pictures because they have to, go by your budget and if need be a friend's recommendation.

On a last note : If you are just an enthusiast and must have the latest, biggest and best, just know that if you have no idea what you are doing; that you should invest in some learning; at least that way if you're approached by someone you don't come off as ignorant. Also pleas don't just use auto mode unless it's a point and shoot. Learn your manual modes, it's like a man who doesn't know how to drive a manual car. Learn your hardware; learn the basics of the reason for having the camera and use your expensive tool as it is meant to be used; nothing is worse than watching a an exquisite machine gather dust, or be used improperly.