Change search
ReferencesLink to record
Permanent link

Direct link
Measuring Student Attention with Face Detection:: Viola-Jones versus Multi-Block Local Binary Pattern using OpenCV
KTH, School of Computer Science and Communication (CSC).
KTH, School of Computer Science and Communication (CSC).
2015 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

The purpose of this study is to discuss and attempt to approach an answer to the question of how face detection could be used to measure attention in a lecture hall.The conclusion might help further studies in using face detection to provide teachers with tools which can be used to improve learning during lectures.

Face detection in real time applications became possible in 2001 when Viola and Jones presented a new method several times faster than any previous attempt. In 2007 Liao et al. presented a method using multi-block local binary patterns (MB-LBP) for the purpose of overcoming the simplicity and limitations of the Viola-Jones method. Computer vision libraries such as OpenCV make it easy to implement such algorithms. It currently supports both the Viola-Jones algorithm and the MB-LBP algorithm.

This study compared these two face detection methods to see how they perform in terms of sensitivity and precision and attempted to identified limitations of both methods when used to detect attention in a simulated lecture environment. The study was conducted using boosted algorithms and functionality provided by OpenCV. The input data consisted of a recorded simulated lecture with 6 subjects performing different poses, labeled either attention or no attention, during certain periods of time, each pose recognized from a previously recorded actual lecture as a commonly occurring pose.

The most significant difference of performance identified in the study was that the MB-LBP method performed face detection in an image three times faster than for Viola-Jones which confirmed previous reported results. Both methods generated high sensitivity values for all poses, but low precision values for two of the poses.The ability of both methods to detect downward tilted faces contributed to a high number of false positives returned when subjects performed the two poses of subjects taking notes or subjects performing activities labeled as no attention. Due to the low precision values caused by this, both methods were not considered to measure attention effectively. It is therefore suggested to instead train a MB-LBP-based method for the specific task of measuring attention in a lecture hall by training it to reject downward-tilted faces and to accept only instances conforming to the chosen definition of attention.

Place, publisher, year, edition, pages
National Category
Computer Science
URN: urn:nbn:se:kth:diva-166416OAI: diva2:810985
Available from: 2015-05-28 Created: 2015-05-08 Last updated: 2015-05-28Bibliographically approved

Open Access in DiVA

fulltext(8467 kB)112 downloads
File information
File name FULLTEXT01.pdfFile size 8467 kBChecksum SHA-512
Type fulltextMimetype application/pdf

By organisation
School of Computer Science and Communication (CSC)
Computer Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 112 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 753 hits
ReferencesLink to record
Permanent link

Direct link