User feedback in continuous software engineering: revealing the state-of-practiceShow others and affiliations
2025 (English)In: Empirical Software Engineering, ISSN 1382-3256, E-ISSN 1573-7616, Vol. 30, no 3, article id 79Article in journal (Refereed) Published
Abstract [en]
Context: Organizations opt for continuous delivery of incremental updates to deal with uncertainty and minimize waste. However, applying continuous engineering (CSE) practices requires a continuous feedback loop with input from customers and end-users.
Challenges: It becomes increasingly challenging to apply traditional requirements elicitation and validation techniques with ever-shrinking software delivery cycles. At the same time, frequent deliveries generate an abundance of usage data and telemetry informing engineering teams of end-user behavior. The literature describing how practitioners work with user feedback in CSE, is limited.
Objectives: We aim to explore the state of practice related to utilization of user feedback in CSE. Specifically, what practices are used, how, and the shortcomings of these practices.
Method: We conduct a qualitative survey and report analysis from 21 interviews in 13 product development companies. We apply thematic and cross-case analysis to interpret the data. Results: Based on our earlier work we suggest a conceptual model of how user feedback is utilized in CSE. We further report the identified challenges with the continuous collection and analysis of user feedback and identify implications for practice.
Conclusions: Companies use a combination of qualitative and quantitative methods to infer end-user preferences. At the same time, continuous collection, analysis, interpretation, and use of data in decisions are problematic. The challenges pertain to selecting the right metrics and analysis techniques, resource allocation, and difficulties in accessing vaguely defined user groups. Our advice to practitioners in CSE is to ensure sufficient resources and effort for interpretation of the feedback, which can be facilitated by telemetry dashboards.
Place, publisher, year, edition, pages
Springer, 2025. Vol. 30, no 3, article id 79
Keywords [en]
Continuous experimentation, Continuous software engineering, Data-driven product development, Software product, User feedback, Resource allocation, Continuous software engineerings, Data driven, End-users, Incremental updates, Software products, State of practise, Uncertainty, Product development
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:bth-27662DOI: 10.1007/s10664-024-10557-2ISI: 001439386100001Scopus ID: 2-s2.0-86000339541OAI: oai:DiVA.org:bth-27662DiVA, id: diva2:1946346
Part of project
SERT- Software Engineering ReThought, Knowledge FoundationContinuous Everything – Cost-benefit evaluation of continuous software engineering
Funder
Knowledge Foundation, 20180010The Research Council of NorwayKnowledge Foundation2025-03-212025-03-212025-03-21Bibliographically approved