Kinect Development

1
Kinect Development

• By
• Richard Isely III

2
Outline

• What is the Kinect
• History
• How it started
• Microsoft Project
• The Components of the Kinect
• What they are/How they work
• Development Issues
• Solution
• Hacking the Kinect
• OpenKinect
• Microsoft SDK
• Demo

3
What is the Kinect?

• Image from http//uncrate.com/p/2010/11/kinect-xl
  .jpg

4
History

• It all started with the Wii
• Moores Big Plans
• Project loses momentum

5
Project Natal

• Alex Kipman takes over project
• PrimeSense Chosen to Create Prototype
• Demo for Executives

6
Components of the Kinect

• Image From http//guide-images.ifixit.net/igi/xKZ
  qFJXNYEGTvYbI.medium

7
Components of the Kinect

• Major components
• IR Projector
• IR Camera
• VGA Camera
• Microphone Array
• Motorized Tilt

Image From http//www.everybodyplays.co.uk/image
s/screenshots/picsforarticles/kinect.jpg
8
VGA Camera

• Allows the Player to be shown on screen.
• Take still shots.

9
Microphone Array

• Four Microphones
• Position Detection
• Noise Cancelation

http//social.microsoft.com/Forums/getfile/18629/
10
Microphone Array(Development Issue)

• Voice Recognition
• Background Noise
• Various Accents

11
Microphone Array(Solution)

• Background Noise
• MSR Team develops Audio processing Solution
• Audio Processing Tricks
• Various Accents
• Acoustical Model built into the Array

12
Motorized Tilt

• Built into the base of the Kinect
• 54 Degree tilt range
• 27 Degrees up
• 27 Degrees down
• Records Actual angle of Kinect

13
IR Projector and Camera(Depth Sensor)

• Whats being projected
• Time of Flight
• How the Kinect does it

Image From http//bbzippo.files.wordpress.com/20
10/11/dsc00014s_thumb.jpg?w700h528
14
IR Projector and Camera (Depth Sensor)
Continued

• ps1080 Chip
• What it produces
• Depth Image

Image From http//www.primesense.com/images/techn
ology/Chip_Diagram.gif
15
Using the Depth Image

• Pixel Data
• 16-bit number
• Depth Data
• Given in millimeters
• Player Data
• Range 0-6

16
Depth Image(Development Issue)

• Initializing Recognition
• Losing Player Mid-Game
• Body Type Issue

17
Depth Image(Solution)

• Breaking up the data
• From 1 Blob to 31 body parts
• Body parts to joints
• Joints to Skeletal image
• Decision Tree

18
Depth Image(Solution)
19
Depth Image(Solution)
20
Hacking the Kinect

• Race to create a driver
• Bounty set
• Cracked in 7 days
• OpenKinect
• PrimeSense Releases Libraries

21
Microsoft SDK

• First Release (June 17th, 2011)
• Skeletal Recognition
• Voice Recognition
• Beta Version
• Latest Release and new Kinect
• Near mode
• Commercial Development
• C, C, and VB

22
Demo
23
Conclusion

• What the future may hold
• Possible Application
• Cheap form of motion detection
• Commercial Availability

24
Sources

• 1 Ashley, James and Jarrett Webb. Beginning
  Kinect Programming with the Microsoft Kinect SDK.
  Apress, 2012. eBook.
• 2 Hall, Jonathan, Sean Kean, and Phoenix Perry.
  Meet the Kinect An Introduction to Programming
  Natural User Interfaces. Apress, 2011. eBook
• 3 Borenstein, Greg. Making Things See 3D
  vision with Kinect, Processing, Arduino, and
  MakerBot. Make, 2012. eBook
• 4 Kinect for Windows. Microsoft Support. Sat.
  10 Mar. 2012.
• lthttp//support.xbox.com/en-US/kinect-for-windows
  /kinect-for-windows-infogt

25
Sources (continued)

• 5 OpenNI. PrimeSense. Sun. 11 Mar. 2012.
• lthttp//75.98.78.94/default.aspxgt
• 6 About PrimeSense. PrimeSense. Sun. 11 Mar.
  2012.
• lthttp//www.primesense.com/en/company-profilegt
• 7 OpenKinect About. OpenKinect. Sat. 17 Mar.
  2012
• lthttp//openkinect.org/wiki/Main_Pagegt
• 8 Kinect for Windows Quickstart Series.
  Channel9. By Dan Fernandez. Sat. 17 Mar. 2012
• lthttp//channel9.msdn.com/Series/KinectQuickstartgt