Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
On the Quantitative Evaluation and Enhancement of Prehospital Decisional Capacity
Uppsala University, Disciplinary Domain of Medicine and Pharmacy, Faculty of Medicine, Department of Surgical Sciences. Uppsala University, Disciplinary Domain of Medicine and Pharmacy, Faculty of Medicine, Department of Public Health and Caring Sciences.ORCID iD: 0000-0001-6775-5051
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Description
Abstract [en]

Prehospital care involves increasingly complex decision-making processes, necessitating commensurate advances in the methods used to assess and improve the quality of patient triage processes. This doctoral project aimed to advance the measurement of patient outcomes in the evaluation of prehospital decision-making and develop interventions to improve those outcomes. In study I, a set of outcome definitions for evaluating referrals to non-emergency care by dispatch nurses was validated, confirming the ability of systematic data abstraction processes to identify patient harms missed by traditional incident reporting systems. In study II, an intervention delivering feedback on process and outcome metrics to dispatch nurses was evaluated, identifying improvements in some process metrics, while impacts on outcomes remained elusive. In study III a machine learning-based approach to estimating composite risk scores was validated internally for use in prehospital contexts. In study IV, similar models for use in Ambulance care were externally validated in a dataset collected from six Swedish regions, finding that model performance remained superior to traditional rule-based risk assessment instruments even when the models were applied in novel settings. Study V is a randomized controlled trial whereby a clinical decision support tool based on these models was found to enhance the ability of dispatchers to identify and prioritize high-risk patients in resource constrained situations. Future directions for study include the incorporation of additional structured and unstructured data in the prediction models, and efforts to evaluate and enhance their fairness and alignment with human assessments of care need. Open-source software packages implementing these tools are available to enhance the transparency of the work and stimulate further development.

Place, publisher, year, edition, pages
Uppsala: Acta Universitatis Upsaliensis, 2025. , p. 73
Series
Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Medicine, ISSN 1651-6206 ; 2149
National Category
Medical Informatics
Research subject
Medical Science
Identifiers
URN: urn:nbn:se:uu:diva-553889ISBN: 978-91-513-2469-2 (print)OAI: oai:DiVA.org:uu-553889DiVA, id: diva2:1950078
Public defence
2025-05-28, H:son Holmdahlsalen, Hus 100, Akademiska sjukhuset, Dag Hammarskjölds 8, Uppsala, 13:00 (Swedish)
Opponent
Supervisors
Available from: 2025-05-06 Created: 2025-04-04 Last updated: 2025-05-06
List of papers
1. Using trigger tools to identify triage errors by ambulance dispatch nurses in Sweden: an observational study
Open this publication in new window or tab >>Using trigger tools to identify triage errors by ambulance dispatch nurses in Sweden: an observational study
Show others...
2020 (English)In: BMJ Open, E-ISSN 2044-6055, Vol. 10, no 3, article id e035004Article in journal (Refereed) Published
Abstract [en]

Objectives: This study aimed to assess whether trigger tools were useful identifying triage errors among patients referred to non-emergency care by emergency medical dispatch nurses, and to describe the characteristics of these patients.

Design: An observational study of patients referred by dispatch nurses to non-emergency care.

Setting: Dispatch centres in two Swedish regions.

Participants: A total of 1089 adult patients directed to non-emergency care by dispatch nurses between October 2016 and February 2017. 53% were female and the median age was 61 years.

Primary and secondary outcome measures: The primary outcome was a visit to an emergency department within 7 days of contact with the dispatch centre. Secondary outcomes were (1) visits related to the primary contact with the dispatch centre, (2) provision of care above the primary level (ie, interventions not available at a typical local primary care centre) and (3) admission to hospital in-patient care.

Results: Of 1089 included patients, 260 (24%) visited an emergency department within 7 days. Of these, 209 (80%) were related to the dispatch centre contact, 143 (55%) received interventions above the primary care level and 99 (38%) were admitted to in-patient care. Elderly (65+) patients (OR 1.45, 95% CI 1.05 to 1.98) and patients referred onwards to other healthcare providers (OR 1.58, 95% CI 1.15 to 2.19) had higher likelihoods of visiting an emergency department. Six avoidable patient harms were identified, none of which were captured by existing incident reporting systems, and all of which would have received an ambulance if the decision support system had been strictly adhered to.

Conclusion: The use of these patient outcomes in the framework of a Global Trigger Tool-based review can identify patient harms missed by incident reporting systems in the context of emergency medical dispatching. Increased compliance with the decision support system has the potential to improve patient safety.

Place, publisher, year, edition, pages
BMJ PUBLISHING GROUP, 2020
National Category
Nursing
Identifiers
urn:nbn:se:uu:diva-411299 (URN)10.1136/bmjopen-2019-035004 (DOI)000527801000174 ()32198303 (PubMedID)
Funder
Vinnova, 2017-04652
Available from: 2020-05-31 Created: 2020-05-31 Last updated: 2025-04-04Bibliographically approved
2. Continuous individual feedback to nurses at emergency medical dispatch centres: a stepped-wedge, interrupted time series analysis
Open this publication in new window or tab >>Continuous individual feedback to nurses at emergency medical dispatch centres: a stepped-wedge, interrupted time series analysis
2025 (English)In: BMJ Open Quality, E-ISSN 2399-6641, Vol. 14, no 1, article id e002993Article in journal (Refereed) Published
Abstract [en]

Background: Clinical feedback is often lacking in prehospital care, and while performance data is increasingly available to clinical and operational leadership, it is seldom made available to care providers themselves. In this study, we investigate the impact of a simple intervention consisting of the provision of monthly feedback reports via email to emergency medical dispatch nurses in three Swedish regions.

Method: Individualised reports consisting of 14 measures divided into descriptive (eg, priority-setting and call times), process (eg, dispatch times and documentation completeness) and outcome (eg, over/under triage rate) categories were developed with staff and management input. Report delivery was implemented using a stepped-wedge design, and effects were evaluated using a hierarchical regression-based interrupted time series analysis.

Results: 40 dispatchers were included in the study between March 2020 and October 2023, who handled a total of 246 353 incidents. Some impacts on documentation-related process measures were identified, with the odds of complete documentation increasing by 7.5% (95% CI 5.1 to 9.9) and the odds of having a documented contact reason increasing by 3.8% (1.5-5.9). These effects remained robust over the post-intervention period. Weaker impacts on outcome measures were identified which could be explained by a higher priority given to emergency medical dispatches overall.

Conclusion: Providing performance data can influence care providers to adjust their behaviour to improve process-related quality metrics under their direct control. The intervention may also have induced nurses to more often upgrade the priority of their patients. Improving outcome metrics may however require more intensive, multifaceted interventions.

Place, publisher, year, edition, pages
BMJ Publishing Group Ltd, 2025
Keywords
Nurses, Audit and feedback, Performance measures, Prehospital care
National Category
Nursing Health Care Service and Management, Health Policy and Services and Health Economy
Identifiers
urn:nbn:se:uu:diva-550396 (URN)10.1136/bmjoq-2024-002993 (DOI)001409962400001 ()39884723 (PubMedID)2-s2.0-85217357532 (Scopus ID)
Available from: 2025-02-19 Created: 2025-02-19 Last updated: 2025-04-04Bibliographically approved
3. A validation of machine learning-based risk scores in the prehospital setting
Open this publication in new window or tab >>A validation of machine learning-based risk scores in the prehospital setting
2019 (English)In: PLOS ONE, E-ISSN 1932-6203, Vol. 14, no 12, article id e0226518Article in journal (Refereed) Published
Abstract [en]

BACKGROUND: The triage of patients in prehospital care is a difficult task, and improved risk assessment tools are needed both at the dispatch center and on the ambulance to differentiate between low- and high-risk patients. This study validates a machine learning-based approach to generating risk scores based on hospital outcomes using routinely collected prehospital data.

METHODS: Dispatch, ambulance, and hospital data were collected in one Swedish region from 2016-2017. Dispatch center and ambulance records were used to develop gradient boosting models predicting hospital admission, critical care (defined as admission to an intensive care unit or in-hospital mortality), and two-day mortality. Composite risk scores were generated based on the models and compared to National Early Warning Scores (NEWS) and actual dispatched priorities in a prospectively gathered dataset from 2018.

RESULTS: A total of 38203 patients were included from 2016-2018. Concordance indexes (or areas under the receiver operating characteristics curve) for dispatched priorities ranged from 0.51-0.66, while those for NEWS ranged from 0.66-0.85. Concordance ranged from 0.70-0.79 for risk scores based only on dispatch data, and 0.79-0.89 for risk scores including ambulance data. Dispatch data-based risk scores consistently outperformed dispatched priorities in predicting hospital outcomes, while models including ambulance data also consistently outperformed NEWS. Model performance in the prospective test dataset was similar to that found using cross-validation, and calibration was comparable to that of NEWS.

CONCLUSIONS: Machine learning-based risk scores outperformed a widely-used rule-based triage algorithm and human prioritization decisions in predicting hospital outcomes. Performance was robust in a prospectively gathered dataset, and scores demonstrated adequate calibration. Future research should explore the robustness of these methods when applied to other settings, establish appropriate outcome measures for use in determining the need for prehospital care, and investigate the clinical impact of interventions based on these methods.

National Category
Other Clinical Medicine Health Care Service and Management, Health Policy and Services and Health Economy
Identifiers
urn:nbn:se:uu:diva-402430 (URN)10.1371/journal.pone.0226518 (DOI)000534232900039 ()31834920 (PubMedID)
Funder
Vinnova, 2017-04652
Available from: 2020-01-15 Created: 2020-01-15 Last updated: 2025-04-04Bibliographically approved
4. Estimating generalization loss in prehospital machine learning risk prediction models: A multicenter internal-external validation study
Open this publication in new window or tab >>Estimating generalization loss in prehospital machine learning risk prediction models: A multicenter internal-external validation study
(English)Manuscript (preprint) (Other academic)
National Category
Medical Informatics
Identifiers
urn:nbn:se:uu:diva-553888 (URN)
Available from: 2025-04-04 Created: 2025-04-04 Last updated: 2025-04-04
5. Machine Learning Assisted Differentiation of Low Acuity Patients at Dispatch (MADLAD): A Randomized Controlled Trial
Open this publication in new window or tab >>Machine Learning Assisted Differentiation of Low Acuity Patients at Dispatch (MADLAD): A Randomized Controlled Trial
(English)Manuscript (preprint) (Other academic)
National Category
Medical Informatics
Identifiers
urn:nbn:se:uu:diva-553887 (URN)
Available from: 2025-04-04 Created: 2025-04-04 Last updated: 2025-04-04

Open Access in DiVA

UUThesis_D-Spangler-2025(1200 kB)24 downloads
File information
File name FULLTEXT01.pdfFile size 1200 kBChecksum SHA-512
e6c5b848accd7b8f8f1215fd90157406f5acb32358bef3708792eed81112a9108d15f2e042b5bd01b84b9281fb2d6983d6229d7346849f4e225eb5ad45e045ad
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Spangler, Douglas
By organisation
Department of Surgical SciencesDepartment of Public Health and Caring Sciences
Medical Informatics

Search outside of DiVA

GoogleGoogle Scholar
Total: 24 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 429 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf