Share via

Project Natal = Awesome! Could you build your own for Windows 7?

  • Article

Holy cow this is cool! 

Just announced at E3 – this is a vision based system that allows your whole body to be a controller. 

Coincidently, I’ve been thinking about vision-based gesture recognition systems lately.   It turns out that Windows 7 has an API called WM_TOUCH that allows you to bring in raw touch data from a touch screen and define your own gestures.  The advantage of this is that you get the “out of the box” Windows 7 gestures automatically, and don’t have create those from scratch.  So that’s touch – where does the vision system come in? 

Well, it should be possible to write a driver that allows a camera (or more likely multiple cameras – especially for 3D space, as is the case with Project Natal) to provide gesture capture to work with that same API.  A similar approach would let you use other techniques to capture gestures, too – e.g., you could use a special glove or a wand.   

XBOX 360 doesn’t use Windows 7, of course, but as amazing as Project Natal is, you could theoretically do your own version on a Windows 7 machine!  You just need to write that driver to capture motion and recognize gestures in 3D space.  Definitely NOT a simple task, to be sure… plan on consulting some rocket scientists…  but also not impossible.  :) 

See here for more WM_TOUCH.

For more on vision-based touch and gesture recognition options, check out these links:

And, of course, see here for more on Project Natal.  As impressive as the Xiroku and Albatron links above are (and they are), the fact that Project Natal works in 3D space rally raises the bar in my mind.  I can’t wait!  :)

UPDATES:

  1. Turns out, Project Natal has an SDK out, too.  :)  Will post again when I have more this.
  2. Good Time article on Project Natal.  Favorite quote:

"The Wii platform is totally engaging and awe-inspiring. But this is one step beyond that."

- Steven Spielberg

Technorati Tags: multi-touch,Project Natal,Windows 7,XBOX Live

Comments

  • Anonymous
    June 03, 2009
    The comment has been removed
  • Anonymous
    June 12, 2009
    The comment has been removed
  • Anonymous
    June 22, 2009
    John, Who do I need to get in touch with for a Natal SDK? Best Regards,
  • JR reinerfrieden [at] hotmail

  • Anonymous
    June 22, 2009
    Regarding the XBOX SDKs (the "regular" ones, not Natal), turns out we actually have 2 versions of this - the XNA Game Studio which anyone can use to create cool Community Games (like Castle Crashers), and the "official" XBOX SDK called the XDK.  The XDK is only available via an "official XBOX Account Manager".   Regarding the Project Natal SDK, I'm told that for now it has very limited availability.  

  • Anonymous
    July 31, 2009
    BTW, here's an article/pic from Ina Fried that shows Project Natal in use outside of XBOX for Windows-based experience.  See here: http://news.cnet.com/8301-13860_3-10299988-56.html?tag=mncol;title Saw this demo in person last week - it's mind blowing.

  • Anonymous
    November 10, 2009
    Hi John, are there any news of the Natal SDK for windows or XBOX? I would really appretiate to get one into my claws. Best regards -

  • Anonymous
    November 18, 2009
    Hi Skyborg, No news, unfortunately.  Game studios have access to XBOX SDK for natal, but no info on an SDK for "natal-like" interaction experiences on Windows at this time.