Change search
ReferencesLink to record
Permanent link

Direct link
Using the Kinect Sensor for Social Robotics
Norwegian University of Science and Technology, Faculty of Information Technology, Mathematics and Electrical Engineering, Department of Engineering Cybernetics.
2011 (English)MasteroppgaveStudent thesis
Abstract [en]

This thesis presents an innovative approach to social robotics through gesture recognition. The focus is on recognizing gestures because this is an important aspect regarding interpretation of a person's intent when he or she gives commands to a robot. The equipment used is a Kinect sensor, developed by Microsoft, attached to a moving platform. The Kinect communicates with software running on a PC through the OpenNI interface and uses the NITE middleware by PrimeSense. The results of this thesis are: - a broad literature study presenting the state of the art of gesture recognition - a system which handles the problems that arise when the Kinect is non-stationary - a gesture recognizer that observes and analyzes human actions There are mainly two problems that are solved by the implemented system. First, user labels might be incorrectly swapped when the Kinect's standard algorithm loses track of a user for a few frames. Second, false-positive users are detected, as the Kinect is assumed stationary. Because of this, everything that moves relative to the Kinect is marked as a user. The first problem is counteracted by mapping the observed label to where it was last seen. The second problem is solved using a combination of optical flow and feature analysis. The gesture recognizer has been developed to allow robust and efficient segmentation, joint detection and gesture recognition. To achieve both high efficiency and good results, these algorithms are tailored to be used with the high quality user silhouettes detected by the Kinect. In addition, the default Kinect algorithm needs some time to initialize when a new human user is detected. The implemented gesture recognizer has no such delay.

Place, publisher, year, edition, pages
Institutt for teknisk kybernetikk , 2011. , 114 p.
Keyword [no]
ntnudaim:5961, MTTK teknisk kybernetikk, Tilpassede datasystemer
URN: urn:nbn:no:ntnu:diva-13862Local ID: ntnudaim:5961OAI: diva2:443557
Available from: 2011-09-26 Created: 2011-09-26

Open Access in DiVA

fulltext(9051 kB)1862 downloads
File information
File name FULLTEXT01.pdfFile size 9051 kBChecksum SHA-512
Type fulltextMimetype application/pdf
cover(267 kB)63 downloads
File information
File name COVER01.pdfFile size 267 kBChecksum SHA-512
Type coverMimetype application/pdf
attachment(9920 kB)1837 downloads
File information
File name ATTACHMENT01.zipFile size 9920 kBChecksum SHA-512
Type attachmentMimetype application/zip

By organisation
Department of Engineering Cybernetics

Search outside of DiVA

GoogleGoogle Scholar
Total: 1862 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 485 hits
ReferencesLink to record
Permanent link

Direct link