It was by far the biggest news to come out of the E3 video game expo last week, and it carries implications far beyond the world of gaming. Heck, even Steven Spielberg was on hand to help unveil it.It’s called “Project Natal,” and it’s the code name for a new device that will one day soon hook into your Xbox 360 — but I’m betting Microsoft will find ways of putting it to use in other ways, too. The technology it uses is just too cutting-edge for it to have only one use. Take a look at the promotional video ( end of post ) MS whipped up to introduce E3 journos to the overall concept.
The add-on will offer features such as auto sign-in for players to Xbox Live (based on complex facial recognition), and sports extremely detailed body tracking which will be able to follow the individual movements of separate limbs. During the press event, the company demoed a painting app, which lets you use your entire body to handle virtual painting supplies, allowing you to do things like throw buckets of paint onto a canvas. Another title was shown off which featured a woman interacting with a young boy on the screen -- one of the company's creepier demos in recent memory. Unfortunately for us, Microsoft says the device won't be released during 2009.
How Natal WorksThe test system was an ordinary Xbox 360, connected to small PC and camera that simulates the final Natal rig. There are two cameras—one RGB, for face recognition and display video, and one infrared, for tracking movement and depth. Why infrared? The eye doesn't see infrared light. And when you combine an infrared camera with an infrared emitter (also part of Natal), a room is flooded with a spectrum of invisible light that works in the dark.
Natal also has its own internal processing system handling an unspecified amount of the heavy lifting behind Natal's cleaver image and speech recognition. It breaks the human body into 48 points tracked in real time, and it can sense your whole body in Z space, or depth. In fact, on a heat map that measured depth, my hands appeared hotter than my shoulders—because they were closer.
Natal is so smart, in fact, that, if your room is narrowed by a pair of couches, it can signal to a game to narrow the level. It can see about 15' x 20' of a room, according to project leader Kudo Tsunoda's informal estimation.
From Microsoft’s Project Natal fact sheet, here’s a list of the tech in question:- Project Natal sensor. Project Natal is the world’s first system to combine an RGB camera, depth sensor, multiarray microphone, and custom processor running proprietary software… The Project Natal sensor tracks full-body movement and individual voices, creating controller-free fun and social entertainment available only on Xbox 360.
- RGB camera. Project Natal has a video camera that delivers the three basic color components. As part of the Project Natal sensor, the RGB camera helps enable facial recognition and more.
- Depth sensor. An infrared projector combined with a monochrome CMOS sensor allows Project Natal to see the room in 3-D (as opposed to inferring the room from a 2-D image) under any lighting conditions.
- Multiarray microphone. Project Natal has a microphone that will be able to locate voices by sound and extract ambient noise. The multiarray microphone will enable headset-free Xbox LIVE party chat and more.
- Custom processor (running Microsoft proprietary software layer). A proprietary software layer makes the magic of Project Natal possible. This layer differentiates Project Natal from any other technology on the market through its ability to enable human body recognition and extract other visual noise.
Possibilities here are endless. Everything from Minority Report style menu to Dance Dance Revolution games that will need to you dance properly instead of using any buttons and instruments to videoconferencing with your friends and co-workers in your living room, this is the future everyone has been waiting for. And it makes the wii seem already out of date. There’s no way wii can currently compete with the Natal project.Press Release:
“Project Natal”: No Strings (or Controllers) Attached
Unveiled for the first time to the public was “Project Natal,” pronounced “nuh-tall” and a code name for a revolutionary new way to play, no controller required. See a ball? Kick it, hit it, trap it or catch it. If you know how to move your hands, shake your hips or speak, you and your friends can jump into the fun. The only experience needed is life experience.
Compatible with any Xbox 360 system, the “Project Natal” sensor is the world’s first to combine an RGB camera, depth sensor, multi-array microphone and custom processor running proprietary software all in one device. Unlike 2-D cameras and controllers, “Project Natal” tracks your full body movement in 3-D, while responding to commands, directions and even a shift of emotion in your voice.
In addition, unlike other devices, the “Project Natal” sensor is not light-dependent. It can recognize you just by looking at your face, and it doesn’t just react to key words but understands what you’re saying. Call a play in a football game, and players will actually respond. Want to log onto Xbox LIVE? Simply step in front of the sensor.
“The next step in interactive entertainment is to make the controller disappear,” said Steven Spielberg, visionary director and producer. “With ‘Project Natal,’ we’ll see games that bring everyone together through technology that actually recognizes us.”

































What is RSS ?











Type