Neural Networks Upscale Film from 1896 to 4K, Make It Look Like It Was Shot on a Modern Smartphone

There are lots of valid reasons to be worried about how deep learning techniques could potentially be used to manipulate footage for nefarious reasons. But as Denis Shiryaev demonstrates by upscaling some old black and white film footage from 1896, those AI-powered tools can also be a powerful way to bring the past back to life.


When watching old film footage that’s plagued with excessive amounts of grain, gate weave, soft focus, and a complete lack of color, it’s hard to feel connected to the people in the clip, or what’s going on. It looks like a movie, and over the years that medium has taught our brains that what they’re seeing on screen might not actually be real. By comparison, the experience of watching videos of friends and family captured on your smartphone is completely different thanks to 4K resolutions and high frame-rates. Those clips feel more authentic and while watching them there’s more of a connection to the moment, even if you weren’t actually there while it was being shot.

In 1896, Louis Lumière, one of the famous Lumière brothers who helped pioneer motion pictures and the equipment used to capture moving images on film, shot a short movie titled L’Arrivée d’un train en gare de La Ciotat which featured a train slowly chugging into a station. The short 45-second clip is most famous for several urban legends regarding moviegoers running out of the theater during showings back in 1896, terrified that an actual train was about to come plowing through the screen. Whether the film actually had that effect on early audiences may never be proven, but given how new and novel the medium was, the short clip certainly would have been a unique experience to someone who’d never seen moving footage before.

L’Arrivée d’un train en gare de La Ciotat doesn’t have the same effect on modern audiences, but Denis Shiryaev wondered if it could be made more compelling by using neural network powered algorithms (including Topaz Labs’ Gigapixel AI and DAIN) to not only upscale the footage to 4K, but also increase the frame rate to 60 frames per second. You might yell at your parents for using the motion smoothing setting on their fancy new TV, but here the increased frame rate has a dramatic effect on drawing you into the action.

Aside from it still being black and white (which could be dismissed as simply an artistic choice) and the occasional visual artifact introduced by the neural networks, the upgraded version of L’Arrivée d’un train en gare de La Ciotat looks like it could have been shot just yesterday on a smartphone or a GoPro. Even the people waiting on the platform look like the costumed historical reenactors you’d find portraying an old-timey character at a pioneer village. The results are far from perfect; we’re hoping Shiryaev applies one of the many deep learning algorithms that can colorize black and white photos to this film as well, but the obvious potential of these tools to enhance historical footage to increase its impact is just as exciting as the potential for it to be misused.

[via Digg]


If you have seen the WWI film “They shall not grow old”, the effect is even more dramatic when color and modern sound are added to old clips. It turns people in old films from jerky cartoon things into actual humans.

On a separate note, I’ve always thought it’s a little creepy to look at old films like that and realize everyone in the film is dead and has been dead for many decades. Even the small children would have died from old age decades ago. If the oldest person who has ever lived had been born when this film were made, they still wouldn’t have made it to today. The last few decades are the first time in human history when we’ve had video documentation of ancestors who couldn’t have possibly lived up to today.