Login REGISTER

Wednesday, 29 July 2009 11:19

Wireless Data Gloves This is my final project of a "Computer graphics" class by professor Christoph Bregler at New York University. The inspiration was a movie "Minority report". In that movie Tom Cruise draws information from a glove-controlled interactive wall.

So that we've created a software that can recognize hand movement and control objects on the screen. And also we've implemented a picture viewer.

In our case user stands in front of the laptop with built in camera and controls pictures using his hands.

Project crew: Ethan Kao, Ashish Dahiya, Kirill Smolskiy

Project timeline: 4 weeks (including design of the idea)

The software can be installed on every operating system. The only thing you need is a web camera and three colour markers. In our case we use gloves with colored fingers.
Tracking systems works using OpenCV libraries and CamShift.

Input device: Wireless data gloves

A pair of gloves with color markers.

Technical details

1. Tracking Color Marker

1. Substract every frame to the first frame to comput background mask.

2. Calculate the backproject in every frame.

3. Compare every pixel in the frame to certain HSV color to create color mask.

4. Do and operation to these three masks to rund camshift

2. Hand Gestures Recognition

Track color markers moving vector to determine what kind of shape the user draw.

Also compute the mean distance from center point to tracking points. Subtract the mean distance with every tracking points to compute a error value to have more accurate result. (Ex: mean distance is radius for circle, so the error value should be small.)