Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Measuring team effectiveness in cyber-defense exercises: A cross-disciplinary case study
Division for Information- and Aeronautical Systems, Swedish Defense Research Agency, Linköping, Sweden.
Division for Information- and Aeronautical Systems, Swedish Defense Research Agency, Linköping, Sweden.
2016 (English)In: Cognition, Technology & Work, ISSN 1435-5558, E-ISSN 1435-5566, Vol. 18, no 1, p. 121-143Article in journal (Refereed) Published
Abstract [en]

In 2010, IT-security experts from northern European governments and organizations gathered to conduct the first of a series of NATO-led cyber-defense exercises in a pilot attempt of training cyber defense. To gain knowledge on how to assess team effectiveness in cyber-defense exercises, this case study investigates the role of behavioral assessment techniques as a complement to task-based performance measurement. The collected data resulted in a massive data set including system logs, observer reports, and surveys. Six different methods were compared for feasibility in assessing the teams’ performance, including automated availability check, exploratory sequential data analysis, and network intrusion detection system attack analysis. In addition, observer reports and surveys were used to collect aspects relating to team structures and processes, aiming to discover whether these aspects can explain differences in effectiveness. The crossdisciplinary approach and multiple metrics create possibilities to study not only the performance-related outcome of the exercise, but also why this result is obtained. The main conclusions found are (1) a combination of technical performance measurements and behavioral assessment techniques are needed to assess team effectiveness, and (2) cyber situation awareness is required not only for the defending teams, but also for the observers and the game control.

Place, publisher, year, edition, pages
Springer London, 2016. Vol. 18, no 1, p. 121-143
Keywords [en]
Cyber-defense exercise, Cyber SA, Performance assessment, Team cognition, Team effectiveness
National Category
Engineering and Technology Production Engineering, Human Work Science and Ergonomics
Identifiers
URN: urn:nbn:se:liu:diva-156502DOI: 10.1007/s10111-015-0350-2ISI: 000368178300009Scopus ID: 2-s2.0-84954360683OAI: oai:DiVA.org:liu-156502DiVA, id: diva2:1306756
Available from: 2019-04-24 Created: 2019-04-24 Last updated: 2019-12-02Bibliographically approved
In thesis
1. Exploring C2 Capability and Effectiveness in Challenging Situations: Interorganizational Crisis Management, Military Operations and Cyber Defence
Open this publication in new window or tab >>Exploring C2 Capability and Effectiveness in Challenging Situations: Interorganizational Crisis Management, Military Operations and Cyber Defence
2019 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Modern societies are affected by various threats and hazards, including natural disasters, cyber-attacks, extreme weather events and inter-state conflicts. Managing these challenging situations requires immediate actions, suspension of ordinary procedures, decision making under uncertainty and coordinated action. In other words, challenging situations put high demands on the command and control (C2) capability. To strengthen the capability of C2, it is vital to identify the prerequisites for effective coordination and direction within the domain of interest. This thesis explores C2 capability and effectiveness in three domains: interorganizational crisis management, military command and control, and cyber defence operations. The thesis aims to answer three research questions: (1) What constitutes C2 capability? (2) What constitutes C2 effectiveness? and (3) How can C2 effectiveness be assessed? The work was carried out as two case studies and one systematic literature review. The main contributions of the thesis are the identification of perspectives of C2 capability in challenging situations and an overview of approaches to C2 effectiveness assessment. Based on the results of the three studies, six recurring perspectives of capability in the domains studied were identified: interaction (collaboration), direction and coordination, relationships, situation awareness, resilience and preparedness. In the domains there are differences concerning which perspectives that are most emphasized in order obtain C2 capability. C2 effectiveness is defined as the extent to which a C2 system is successful in achieving its intended result. The thesis discusses the interconnectedness of performance and effectiveness measures, and concludes that there is not a united view on the difference between measures of effectiveness and measures of performance. Different approaches to effectiveness assessment were identified, where assessment may be conducted based on one specific issue, in relation to a defined goal for a C2 function or using a more exploratory approach.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2019. p. 43
Series
Linköping Studies in Science and Technology. Licentiate Thesis, ISSN 0280-7971 ; 1836
National Category
Computer Sciences Computer and Information Sciences Information Systems, Social aspects Software Engineering Social Sciences Interdisciplinary
Identifiers
urn:nbn:se:liu:diva-156151 (URN)10.3384/lic.diva-156151 (DOI)9789176850824 (ISBN)
Presentation
2019-06-14, Alan Turing, hus E, Campus Valla, Linköping, 10:15 (English)
Opponent
Supervisors
Note

In the printed version is the permanent link to this publication incorrect. The link is changecd in the online version.

Available from: 2019-05-27 Created: 2019-05-02 Last updated: 2019-05-27Bibliographically approved

Open Access in DiVA

Measuring team effectiveness in cyber-defense exercises: A cross-disciplinary case study(1285 kB)47 downloads
File information
File name FULLTEXT02.pdfFile size 1285 kBChecksum SHA-512
6c42cc275d23e69c0ac064cb6d64d746bf44ed76a567e4d38742132300fbdc24b98c676319f300382eb3ca259046fc26e45b0613f1c0dd894012190fd7369196
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Granåsen, MagdalenaAndersson, Dennis
In the same journal
Cognition, Technology & Work
Engineering and TechnologyProduction Engineering, Human Work Science and Ergonomics

Search outside of DiVA

GoogleGoogle Scholar
Total: 47 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 55 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf