Photographs Enhance Video in Absolutely Unbelievable Ways

Illustration for article titled Photographs Enhance Video in Absolutely Unbelievable Ways

Before Gizmodo, I worked in the bowels of the broadcast industry for a number of years. I was either shooting video or cutting video every day, all day. And while Final Cut Pro and Adobe After Effects were both tools I used with some proficiency on a daily basis, I've never seen a post production demo as incredible as this clip from the University of Washington. Essentially, you shoot some crappy, low-rez video of a still scene. You then reshoot the same scene with a digital camera (with higher resolution). Software can automagically combine these images to upconvert the video AND fix problems in the image- all while compensating for 3D space. Make sense? The remarkable demo will clarify things a bit:


What's especially notable is that the software can fill in the nasty bits of the scene despite the videographer/photographer rotating their view (you see this as they shoot around the tree) and despite any lens differences (the software can compensate for different lens sizes/distortions). Also, note that many details from the source video are retained (the glass reflections in the statue shot may be the best example), which means that the photograph's information isn't the only information we see in the composite image. I'm not quite convinced that the entire process is quite as automatic as the students would make it, but the technology is extremely promising all the same. And at this point, it should only be a matter of time before we see the idea work its way into our favorite post production products. [Project Page via bbGadgets]


@Noobs-R-Us: What you are talking about is already being done and will soon be in commercial cameras.

However, you don't need to decrease the display frame rate with HDR. You can capture at, say, 30 fps and output at 30 fps.

For a frame sequence: 1,2,3,... where odd frames are short exposure and even are long exposure, the first displayed frame is an HDR combination of 1 & 2. So a short + long. The next frame displayed is a combination of 2 & 3. So a long + short. And so on.