Gizmodo: Input

Apple Multi-Touch Data Fusion Adds Camera, Voice, Force Sensors

Jesus Diaz — Thu, 04 Sep 2008 05:53:00 EDT

Apple has been working in new multi-touch technology that combines touch interfaces with input from the camera and the microphone. For example: this will allow you to select text in the iPhone, say "copy," go to another application and say "paste" to make this task really easy. The most intriguing part, however, is the use of a camera in laptops and desktops.

This will require two cameras, one for video chat and the other for the "hand reading," but it opens a lot of possibilities. To start with, the entire keyboard can become a gesture control pad without even having to touch the surface. In addition to that, it can be combined with actual touch technology to identify single fingers on the surface, with the possibility of assigning specific functions to them.

The system even contemplates combining all this with accelerometers and force sensors, so the touch action can generate secondary data. One example of this may be applying a deformation effect to an image or a sound effect to a music track, giving it more or less strength depending on the force you use in your action. [USPTO via Unwired View]

Microsoft UnMouse Pad Prototype is Paper Thin, Pressure Sensitive, Multitouch on Steroids

Adrian Covert — Wed, 30 Jul 2008 18:30:32 EDT

The UnMouse Pad is like the MacBook Air/Pro's multitouch trackpad on steroids. On display at the Microsoft Research Summit (which also housed the Microsoft Sphere), this Joint project between Microsoft and NYU utilizes Force-Sensing Resistors to create one giant, mouse pad-sized circuit.

In the last part of the video, you can see the insane amount of input points the UnMouse Pad can track, and the rising bars indicate the amount of pressure applied at each point (especially when I press my whole hand on the pad). According to creator Ken Perlin, the technology used in the UnMouse Pad is dirt cheap as well, which could make it friendly for consumer markets. [Microsoft Research]

Microsoft: Touchscreens Old and Busted; Force Sensitivity Is New Hotness

matt buchanan — Sat, 19 Apr 2008 21:30:00 EDT

Craving a bit deeper, more meaningful interaction action with your touchscreen gadget, like maybe stretching or squeezing it? Microsoft thought so. Researchers have come up with a prototype of their force-sensing tech that'll let you apply different kinds of force to a device, like twisting or bending, to do stuff like flip through document pages or swing through applications.

The modded Samsung UMPC has four sensors that detect how you're trying to manipulate it, so it doesn't have to actually be flexible. The researchers think the tech will complement—not replace—touchscreens, making devices more active and engaging, not to mention smaller, since space-wasting buttons will be unnecessary.

I feel kinda bad for buttons right now, everyone wants to get rid of them. But they'll have their day again, when button nostalgia sweeps the land. [BBC, Thanks Tolu!]

Elliptic Touchless UI Puts the Input Interface in Thin Air

Haroon Malik — Sun, 03 Feb 2008 11:00:00 EST

Touchscreen interfaces are great, but all that touching, like foreplay, can be a little bit of a drag. Enter the wonder kids from Elliptic Labs, who are hard at work on implementing a touchless interface. The input method is, well, in thin air. The technology detects motion in 3D and requires no special worn-sensors for operation. By simply pointing at the screen, users can manipulate the object being displayed in all three dimensions. Details are light on how this actually functions, but what we do know is this:

Sensors are mounted around the screen that is being used, by interacting in the line-of-sight of these sensors the motion is detected and interpreted into on-screen movements. What is to stop unintentional gestures being used as input is not entirely clear, but it looks promising nonetheless. The best part? Elliptic Labs says their technology will be easily small enough to be implemented into cellphones and the like. iPod touchless, anyone? Check out the video to see it in action. [Elliptic Labs via Technabob]

Use a Wiimote to Make Whiteboards Out of Anything

Jason Chen — Mon, 10 Dec 2007 13:53:34 EST

Johnny Lee's description of "Low-Cost Multi-point Interactive Whiteboards Using the Wiimote" may sound boring, but it's actually a very cool and very innovative use of the Wiimote. Since you can hook the controller up to your computer and accept inputs using the Wiimote library interface, you can use its infrared sensors to detect and track infrared light on any kind of surface. With Johnny's app, you can in turn use a cheap DIY IR pen as an input device and make your own whiteboard/input tablet. You should watch the video to see more, but this thing looks really exciting. [CMU - Thanks Adam!]

Xbox 360 Input Machine Has Gamer Playing Halo 2 With Wiimote

kthompson — Tue, 07 Aug 2007 18:49:58 EDT

It's impossible to ignore the unique brand of fun the Wii brings to the table with its motion-sensitive controller, but if you aren't into minigame fests, you don't have a lot of options for taking advantage of it. That's why one dedicated gamer decided to meld the power of the Wiimote with the game library of the Xbox 360, producing what he calls the Xbox 360 Input Machine (XIM). As you can see in the video above, Master Chief is running around the Halo 2 world, jumping and firing via instructions from the Wiimote (including motion-sensing swings). But can you realistically expect to be plugging your Wii into your 360 any time soon?

Probably not. The system is actually rather complicated, consisting of a PS2 to Xbox 360 adapter along with a custom microcontroller with hand coded firmware that emulates a PS2 controller in addition to a connected PC running a customized Wiimote driver. Each game also requires a specially-designed "profile" that tells the system how to use the new control method given native 360 bindings and features like aim assistance. What that all means is that unless you're a pretty serious gearhead, you'll have to wait for the entire rig to be simplified and released on the market before you'll have Master Chief jumping with nunchuk thrusts. If I were you, I wouldn't get my hopes up just yet. [Xbox 360 Gaming With A Wiimote]

Microsoft Natural Ergonomic Desktop 7000 Uses 2.4GHz Tech

Charlie White — Tue, 19 Jun 2007 07:36:33 EDT

Take the Microsoft Natural Ergonomic Keyboard 4000, cut the cable, throw in a Natural Wireless Laser Mouse 6000 and then add 2.4GHz wireless connectivity to both, and you have the Microsoft Natural Ergonomic Desktop 7000. If you like that gullwing design of the keyboard, this might just be a perfect fit for you.

Take the jump for more info, another pic and pricing information.

Before you immediately dismiss this wireless technology, I must tell you that I also completely rejected wireless keyboards and mice until I tried Microsoft's Wireless Comfort Keyboard 4000 and its accompanying Wireless Laser Mouse 5000 about six months ago, and I'm now a new convert to Microsoft's wireless technology. It's downright excellent. And this keyboard and mouse I'm using aren't even using this latest, more-sophisticated 2.4GHz technology.

Seriously, it's every bit as good as any wired keyboard and mouse I've used. If it's any indication, this improved 2.4GHz tech that works up to 30 feet away will be even better. Yep, I can say without irony that Microsoft (and Logitech, too) have figured out how to make useful wireless input devices. Finally, at long last.

Microsoft says the Natural Ergonomic Desktop 7000 will be available next month for $149.95. – Charlie White

Microsoft Shift Makes Cellphone Finger Input Easier (But Not Booger Free)

Jason Chen — Thu, 17 May 2007 19:00:36 EDT

The shift project from Microsoft research has a goal that may not seem lofty at first, but could possibly help shape cellphone touchscreen technology in a big way. Traditionally, with Windows Mobile phones and other touchscreen phones, you have to use a stylus because your finger is too fat and unwieldy. Even Apple's iPhone, with its crazy gropeability, doesn't solve the problem of your finger being in the way of what you're trying to click.

Microsoft's Shift, on the other hand, re-creates whatever's underneath your poker so you can actually see what you're clicking on. Plus, there's added visual feedback so you can narrow down your inputs as well. Check out the video on their site for a closer look. – Jason Chen

Project Site [Microsoft Research via jkontherun]

uPlusPen is like a Tablet, Minus the Tablet

Travis Hudson — Fri, 22 Dec 2006 12:26:44 EST

uPlusPen is the latest input device straight out of Korea. It is similar to a Wacom-style tablet, but there is no actual tablet. The pen can write on any surface and be transferred to the computer. This could be perfect for those on-the-go graphic designers who don't want to lug a tablet everywhere, or for someone who doesn't have the office-space for a giant tablet. No word on availability or pricing. Image via Aving – Travis Hudson

uPlusPen - PC Tablet for Writing and Drawing without the Tablet [Everything USB]