Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
User feedback in continuous software engineering: revealing the state-of-practice
SINTEF, Norway.ORCID iD: 0000-0001-7391-4194
Blekinge Institute of Technology, Faculty of Computing, Department of Software Engineering.ORCID iD: 0000-0002-1987-2234
SINTEF, Norway.
SINTEF, Norway.
Show others and affiliations
2025 (English)In: Empirical Software Engineering, ISSN 1382-3256, E-ISSN 1573-7616, Vol. 30, no 3, article id 79Article in journal (Refereed) Published
Abstract [en]

Context: Organizations opt for continuous delivery of incremental updates to deal with uncertainty and minimize waste. However, applying continuous engineering (CSE) practices requires a continuous feedback loop with input from customers and end-users.

Challenges: It becomes increasingly challenging to apply traditional requirements elicitation and validation techniques with ever-shrinking software delivery cycles. At the same time, frequent deliveries generate an abundance of usage data and telemetry informing engineering teams of end-user behavior. The literature describing how practitioners work with user feedback in CSE, is limited.

Objectives: We aim to explore the state of practice related to utilization of user feedback in CSE. Specifically, what practices are used, how, and the shortcomings of these practices.

Method: We conduct a qualitative survey and report analysis from 21 interviews in 13 product development companies. We apply thematic and cross-case analysis to interpret the data. Results: Based on our earlier work we suggest a conceptual model of how user feedback is utilized in CSE. We further report the identified challenges with the continuous collection and analysis of user feedback and identify implications for practice.

Conclusions: Companies use a combination of qualitative and quantitative methods to infer end-user preferences. At the same time, continuous collection, analysis, interpretation, and use of data in decisions are problematic. The challenges pertain to selecting the right metrics and analysis techniques, resource allocation, and difficulties in accessing vaguely defined user groups. Our advice to practitioners in CSE is to ensure sufficient resources and effort for interpretation of the feedback, which can be facilitated by telemetry dashboards. 

Place, publisher, year, edition, pages
Springer, 2025. Vol. 30, no 3, article id 79
Keywords [en]
Continuous experimentation, Continuous software engineering, Data-driven product development, Software product, User feedback, Resource allocation, Continuous software engineerings, Data driven, End-users, Incremental updates, Software products, State of practise, Uncertainty, Product development
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-27662DOI: 10.1007/s10664-024-10557-2ISI: 001439386100001Scopus ID: 2-s2.0-86000339541OAI: oai:DiVA.org:bth-27662DiVA, id: diva2:1946346
Part of project
SERT- Software Engineering ReThought, Knowledge FoundationContinuous Everything – Cost-benefit evaluation of continuous software engineering
Funder
Knowledge Foundation, 20180010The Research Council of NorwayKnowledge FoundationAvailable from: 2025-03-21 Created: 2025-03-21 Last updated: 2025-03-21Bibliographically approved

Open Access in DiVA

fulltext(682 kB)25 downloads
File information
File name FULLTEXT01.pdfFile size 682 kBChecksum SHA-512
7ac8539dfbc49657d9656d4fe290935a72232f4873ed26325c33437c540795702a2916964ab50012d46bc6d63ed9fcb6632cb86eff85bae4b40fe5e8d179f06f
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Tkalich, AnastasiiaKlotins, EriksMoe, Nils Brede
By organisation
Department of Software Engineering
In the same journal
Empirical Software Engineering
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 27 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 1358 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf