Seamless-walk: natural and comfortable virtual reality locomotion method

The Seamless-walk system uses MIT’s intelligent carpet technology to capture the user’s “high-resolution foot pressure imprints” as they stand, walk, and even run in place, on the mat. The data from the mat’s sensors are processed by a machine learning model that is able to not only differentiate the pressure from a user’s left and right feet, but extrapolate their intended movements and speed, whether they’re walking or running forwards or back, or simply turning from side to side. The mat replaces the need for a handheld joystick, as well as other hardware like body-mounted motion sensors or a camera base station.


Having users physically move their bodies to navigate a virtual world could be the key to reducing the motion sickness that many experience when strapping on a VR headset. If a VR character’s movements are gently bobbing from side to side as they’re walking, but the user’s brain isn’t detecting those same movements in the real world because the user is standing still and just moving a tiny joystick, that sensory separation can lead to confusion, dizziness, and even nausea. It’s one of the biggest things holding VR back from wider adoption, and alternate solutions likes teleporting characters or room scale VR can only go so far (about as far as your living room, in the case of the latter). But this foot-sensing mat could help make infinite movement options more accessible, because it could be mass-produced on the cheap, and can be easily rolled up and stored at the end of a VR session, unlike solutions where the hardware occupies a big chunk of floor space when not in use.

The obvious downside to the mat is that users don’t actually move around on it, and instead have to walk and run in place, which, as the video above demonstrates, could be easily confused for them impatiently waiting to use the bathroom. 

The system could be scaled up, however, and a foot-sensing mat could be created that’s large enough to fill an entire warehouse, allowing VR users to more naturally walk and run around in real life, and in their virtual worlds, without being tethered to other hardware to detect their movements. But until we figure out how the Holodecks keep users from running into walls eventually, maybe the “I have to pee” dance approach is as good as it will get.