Change search
ReferencesLink to record
Permanent link

Direct link
Virtual lead-through robot programming: Programming virtual robot by demonstration
University of Skövde, School of Engineering Science.
2015 (English)Independent thesis Basic level (degree of Bachelor), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

This report describes the development of an application which allows a user to program a robot in a virtual environment by the use of hand motions and gestures. The application is inspired by the use of robot lead-through programming which is an easy and hands-on approach for programming robots, but instead of performing it online which creates loss in productivity the strength from offline programming where the user operates in a virtual environment is used as well. Thus, this is a method which saves on the economy and prevents contamination of the environment. To convey hand gesture information into the application which will be implemented for RobotStudio, a Kinect sensor is used for entering the data into the virtual environment. Similar work has been performed before where, by using hand movements, a physical robot’s movement can be manipulated, but for virtual robots not so much. The results could simplify the process of programming robots and supports the work towards Human-Robot Collaboration as it allows people to interact and communicate with robots, a major focus of this work. The application was developed in the programming language C# and has two different functions that interact with each other, one for the Kinect and its tracking and the other for installing the application in RobotStudio and implementing the calculated data into the robot. The Kinect’s functionality is utilized through three simple hand gestures to jog and create targets for the robot: open, closed and “lasso”. A prototype of this application was completed which through motions allowed the user to teach a virtual robot desired tasks by moving it to different positions and saving them by doing hand gestures. The prototype could be applied to both one-armed robots as well as to a two-armed robot such as ABB’s YuMi. The robot's orientation while running was too complicated to be developed and implemented in time and became the application's main bottleneck, but remained as one of several other suggestions for further work in this project.

Place, publisher, year, edition, pages
2015. , 67 p.
Keyword [en]
Lead-through, programming by demonstration, dual arm robot, motion sensor, virtual environment, human-robot collaboration
National Category
URN: urn:nbn:se:his:diva-11403OAI: diva2:848016
Subject / course
Automation Engineering
Educational program
Industrial Automation Engineer
Available from: 2015-08-24 Created: 2015-08-23 Last updated: 2015-08-24Bibliographically approved

Open Access in DiVA

fulltext(2100 kB)709 downloads
File information
File name FULLTEXT01.pdfFile size 2100 kBChecksum SHA-512
Type fulltextMimetype application/pdf

By organisation
School of Engineering Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 709 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 494 hits
ReferencesLink to record
Permanent link

Direct link