← Portfolio
Open source

Gesture recognition with Kinect

Industry
Human-computer interaction
Type of work
Sequence machine learning
Period
2012
View on GitHub ↗

Architecture

Kinect 3D skeleton Trajectory hand position K-means position → symbol Sequence of symbols HMM per gesture maximumlikelihood C# · Kinect SDK · one hidden Markov model per gesture

Goal

Recognize hand gestures from the skeleton Kinect provides. Built for the User Experience course at UAI.

What I did

  • Captured the hand trajectory from the Kinect skeleton.
  • Quantized each position with K-means to turn movement into a symbol sequence.
  • Trained one hidden Markov model per gesture and classified by maximum likelihood.

Stack

C#Kinect SDKK-meansHMM