Relying on thin sensors printed directly onto the plastic's surface, the shape, movement, and deformation of the film can be detected and translated to software without the need for cameras or any kind of external tracking.

Microsoft's researchers envision the FlexSense film being used alongside existing apps for new methods of interaction. For example, when photo-editing on a tablet, peeling back the film could automatically remove the effects of a filter, revealing the original image. And for hand-drawn animation the film could be used as a digital version of onion skin, letting an animator trace an image underneath, and easily flip back and forth between frames. It even has the potential to make ebooks feel more like traditional printed tomes, letting readers physically flip back and forth between pages of a magazine, making the transition from print to digital a little less jarring.


It's not clear how long it'll be until we actually see this turning up in products, but the fact that it exists—and works—is terrifically exciting in its own right. [Microsoft Research via Damn Geeky]