Change search
ReferencesLink to record
Permanent link

Direct link
What's in your mind?: Collegial Verbalisation – An ecological approach to knowledge elicitation
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Visual Information and Interaction. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computerized Image Analysis and Human-Computer Interaction.
2014 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Knowledge elicitation of the work of professional operators, using traditional methods such as concurrent or retrospective verbalization is problematic. Concurrent verbalization distracts the operators from their primary task, and the operators have difficulties in verbalizing about their automated work tasks. Retrospective verbalization on the other hand, suffers from rationalization problems. An operator might give a perfectly good explanation of some action taken and might also be completely confident about truth of the verbalized information, when it in fact is incorrect. To overcome some of these problems, this thesis presents a new complementary verbalization method called Collegial Verbalization (CV).

The CV-method utilizes the shared knowledge among work colleagues to improve the quality of the resulting information. The method consists roughly of the following steps; (1) Video tape subjects while they are working. (2) Play back interesting events to the subject’s colleagues individually and let them verbalize on the subject’s actions. (3) Compare the colleagues’ verbal reports to each other to find similarities, differences, etc. Throughout my research I have formulated, defined and assessed the new method in detail. The method has been applied to study train drivers, high-speed ferry operators, train traffic dispatchers and the medical staff at intensive care units.

Comparative studies have shown; (1) that CV-protocols can be used as an independent source of data, (2) that colleagues produce reports with similar characteristics of retrospective verbal reports, (3) that the CV-method can produce more information than retrospective verbalization, because of the advantage of using multiple narrators. When the intention is to gather data as input to design, rather than establishing the original thought processes form the time of the studied events, the CV-method can also produce more reliable information than retrospective verbalization, because of the advantage of using multiple narrators.

Based on these results, I have concluded that the CV-method has a clear advantage as a complementary information acquisition method, when studying the work of professional operators. The thesis ends with a discussion about several additional possible applications for the CV-method, such as applied team learning or psychological research in the field of decision making.

Place, publisher, year, edition, pages
Uppsala: Acta Universitatis Upsaliensis, 2014. , 108 p.
Series
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology, ISSN 1651-6214 ; 1147
National Category
Human Computer Interaction
Research subject
Computer Science with specialization in Human-Computer Interaction
Identifiers
URN: urn:nbn:se:uu:diva-223173ISBN: 978-91-554-8952-6OAI: oai:DiVA.org:uu-223173DiVA: diva2:712861
Public defence
2014-06-04, Room 2446, Polacksbacken, Lägerhyddsvägen 2, Uppsala, 10:15 (English)
Opponent
Supervisors
Available from: 2014-05-13 Created: 2014-04-16 Last updated: 2014-06-30Bibliographically approved
List of papers
1. Augmented reality as a navigation aid for the manoeuvring of High-Speed Crafts
Open this publication in new window or tab >>Augmented reality as a navigation aid for the manoeuvring of High-Speed Crafts
2004 (English)In: DESIGN 2004 conference, 2004Conference paper (Other academic)
National Category
Engineering and Technology
Identifiers
urn:nbn:se:uu:diva-47957 (URN)
Conference
Design 2004
Available from: 2006-11-24 Created: 2006-11-24 Last updated: 2014-05-13
2. Bridging the gap between analysis and design: Improving existing driver interfaces with tools from the framwork of cognitive work analysis
Open this publication in new window or tab >>Bridging the gap between analysis and design: Improving existing driver interfaces with tools from the framwork of cognitive work analysis
2006 (English)In: Cognition, Technology & Work, ISSN 1435-5558, E-ISSN 1435-5566, Vol. 8, no 1, 41-49 p.Article in journal (Refereed) Published
Abstract [en]

Two studies of train driving are presented, both within the framework of cognitive work analysis. In the first study, the modelling tool abstraction–decomposition space is adapted to routine conditions, making the analysis more representative for normal procedures. A major contribution to these analyses was the use of the method for ‘collegial verbalisation’. One particular advantage with this method over other verbalisation methods is that it supplies the analysts with data that contain much more information, but not at the expense of being more subjective. On the contrary, this method produces think-aloud protocols from video-recordings that do not have to be interpreted by the researcher. From these analyses, it was possible to distinguish information that is an intrinsic part of the train driver task from information that is dependent on the configuration and design of the current support system. The analyses show that the driver works in three rather separate time intervals with a long-range, a short-term and an immediate sense of perspective. The driver switches between these while travelling between two stations. Based on these behaviour-shaping constraints, a prototype of a planning area of a driver interface was developed, making feed-forward planning possible for the driver. Four design iterations were completed, using a user-centred system design (UCSD) approach. Early tests show that the planning area of the interface supports the feed-forward decision strategy used by drivers who prefer an active driving style. However, the driver group also made substantial changes in the design, indicating that UCSD is an efficient tool in order to capture user competencies, and to bridge the gap between analysis and design.

Keyword
cognitive work analysis, driver interface, verbal protocols, user centred system design, participatory design, prototyping
National Category
Engineering and Technology
Identifiers
urn:nbn:se:uu:diva-78792 (URN)10.1007/s10111-005-0018-4 (DOI)
Available from: 2006-03-30 Created: 2006-03-30 Last updated: 2014-05-13Bibliographically approved
3. Collegial verbalisation: a case study on a new method on information acquisition
Open this publication in new window or tab >>Collegial verbalisation: a case study on a new method on information acquisition
2007 (English)In: Behaviour & Information Technology, ISSN 0144-929X, Vol. 26, no 6, 535-543 p.Article in journal (Refereed) Published
National Category
Computer and Information Science
Identifiers
urn:nbn:se:uu:diva-14902 (URN)10.1080/01449290600801934 (DOI)000250361500009 ()
Available from: 2008-01-31 Created: 2008-01-31 Last updated: 2014-05-13Bibliographically approved
4. Verbal reports and domain-specific knowledge: a comparison between collegial and retrospective verbalisation
Open this publication in new window or tab >>Verbal reports and domain-specific knowledge: a comparison between collegial and retrospective verbalisation
2013 (English)In: Cognition, Technology & Work, ISSN 1435-5558, E-ISSN 1435-5566, Vol. 15, no 3, 239-254 p.Article in journal (Refereed) Published
Abstract [en]

One way to investigate and account for the role of experience in dynamic decision-making tasks is to use a knowledge elicitation method, for example verbal protocols. Recently, methods for verbalisation by other subjects have been suggested as a way to elicit more information on thinking. One of these methods is here investigated in a quasi-experimental study on highly experienced and skilled train dispatchers. Collegial verbalisation is based on the procedure of videotaping practitioners while they perform their normal work tasks in their normal work setting. This is followed up by having a close colleague of the practitioner watch the video recordings and verbalise. The general hypothesis that verbal reports based on collegial verbalisations can provide protocol data that are close to the structure and content of verbal reports based on retrospective verbalisations was investigated. From this systematic comparison it is concluded that collegial verbalisations produce verbal protocols that are close to the retrospective verbal protocols on protocol and topic levels, but not on statement level. From this study, we conclude that the collegial protocols can be used as an independent source of data. It seems possible for a colleague to report verbally on a practitioners' observable behaviour in the same way as when the practitioner is doing a retrospective verbalisation and it may also be possible for a colleague to explain some of the non-observable behaviour of the practitioner.

Place, publisher, year, edition, pages
Springer London, 2013
National Category
Human Computer Interaction
Research subject
Human-Computer Interaction
Identifiers
urn:nbn:se:uu:diva-183343 (URN)10.1007/s10111-012-0223-x (DOI)000322162100001 ()
Available from: 2012-03-20 Created: 2012-10-24 Last updated: 2014-05-13Bibliographically approved
5. Collegial verbalisation: The value of verbal reports from colleagues as subjects
Open this publication in new window or tab >>Collegial verbalisation: The value of verbal reports from colleagues as subjects
(English)Manuscript (preprint) (Other academic)
National Category
Engineering and Technology
Research subject
Human-Computer Interaction
Identifiers
urn:nbn:se:uu:diva-215393 (URN)
Available from: 2014-01-13 Created: 2014-01-13 Last updated: 2014-05-13
6. Collegial collaboration for safety: Assessing situation awareness by exploring cognitive strategies
Open this publication in new window or tab >>Collegial collaboration for safety: Assessing situation awareness by exploring cognitive strategies
2013 (English)In: Past History and Future Challenges of Human Work Interaction Design (HWID): Generating Cross-domain Knowledge about Connecting Work Analysis and Interaction Design / [ed] Torkil Clemmensen, Bengt Sandblad, Arminda Lopes and Jose Abdelnour- Nocera, 2013, 35-40 p.Conference paper (Refereed)
Series
, Workshop Proceedings Series of the INTERACT 2013 Conference
National Category
Engineering and Technology
Research subject
Human-Computer Interaction
Identifiers
urn:nbn:se:uu:diva-211403 (URN)978-0-620-58037-3 (ISBN)
Conference
Workshop at INTERACT 2013 – 14th IFIP TC13 Conference on Human-Computer Interaction, Cape Town, South Africa, September 2013
Available from: 2013-11-22 Created: 2013-11-22 Last updated: 2014-05-13Bibliographically approved
7. Recognizing complexity: A prerequisite for skilled intuitive judgments and dynamic decisions
Open this publication in new window or tab >>Recognizing complexity: A prerequisite for skilled intuitive judgments and dynamic decisions
2013 (English)In: SPUDM24: Subjective Probability, Utility, and Decision Making, 2013, 194- p.Conference paper, Abstract (Refereed)
National Category
Psychology (excluding Applied Psychology)
Research subject
Human-Computer Interaction
Identifiers
urn:nbn:se:uu:diva-214492 (URN)
Conference
SPUDM24 - Subjective Probability, Utility, and Decision Making Conference (SPUDM); 18-22 August 2013; IESE Business School, Barcelona, Spain
Available from: 2014-01-08 Created: 2014-01-08 Last updated: 2014-05-13Bibliographically approved

Open Access in DiVA

fulltext(7657 kB)229 downloads
File information
File name FULLTEXT02.pdfFile size 7657 kBChecksum SHA-512
da0d95b0e412bb0594a054df5f09dcb1e95cb2caf35ea86f68bcad42f2a7badbfbf6b8730da419407f266577866e125f5b23e405a0ac2552896c748ca6419700
Type fulltextMimetype application/pdf
Buy this publication >>

Search in DiVA

By author/editor
Erlandsson, Mikael
By organisation
Division of Visual Information and InteractionComputerized Image Analysis and Human-Computer Interaction
Human Computer Interaction

Search outside of DiVA

GoogleGoogle Scholar
Total: 229 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 848 hits
ReferencesLink to record
Permanent link

Direct link