Investigating the discriminative value of Early Warning Scores in patients with respiratory disease using a retrospective cohort analysis of admissions to Nottingham University Hospitals Trust over a 2-year period

Forster, Sarah; Housley, Gemma; McKeever, Tricia M.; Shaw, Dominick E.

Abstract

Objective: Early Warning Scores (EWSs) are used to monitor patients for signs of imminent deterioration. Although used in respiratory disease, EWSs have not been well studied in this population, despite the underlying cardiopulmonary pathophysiology often present. We examined the performance of two scoring systems in patients with respiratory disease.
Design: Retrospective cohort analysis of vital signs observations of all patients admitted to a respiratory unit over a 2-year period. Scores were linked to outcome data to establish the performance of the National EWS (NEWS) compared results to a locally adapted EWS.
Setting: Nottingham University Hospitals National Health Service Trust respiratory wards. Data were collected from an integrated electronic observation and task allocation system employing a local EWS, also generating mandatory referrals to clinical staff at set scoring thresholds.
Outcome measures: Projected workload, and sensitivity and specificity of the scores in predicting mortality based on outcome within 24 hours of a score being recorded.
Results: 8812 individual patient episodes occurred during the study period. Overall, mortality was 5.9%. Applying NEWS retrospectively (vs local EWS) generated an eightfold increase in mandatory escalations, but had higher sensitivity in predicting mortality at the protocol cut points.
Conclusions: This study highlights issues surrounding use of scoring systems in patients with respiratory disease. NEWS demonstrated higher sensitivity for predicting death within 24 hours, offset by reduced specificity. The consequent workload generated may compromise the ability of the clinical team to respond to patients needing immediate input. The locally adapted EWS has higher specificity but lower sensitivity. Statistical evaluation suggests this may lead to missed opportunities for intervention, however, this does not account for clinical concern independent of the scores, nor ability to respond to alerts based on workload. Further research into the role of warning scores and the impact of chronic pathophysiology is urgently needed.

Citation

Forster, S., Housley, G., McKeever, T. M., & Shaw, D. E. (2018). Investigating the discriminative value of Early Warning Scores in patients with respiratory disease using a retrospective cohort analysis of admissions to Nottingham University Hospitals Trust over a 2-year period. BMJ Open, 8(7), Article e020269. https://doi.org/10.1136/bmjopen-2017-020269

• Journal Article Type: Article
• Acceptance Date: May 3, 2018
• Online Publication Date: Jul 30, 2018
• Publication Date: Jul 30, 2018
• Deposit Date: Aug 6, 2018
• Publicly Available Date: Aug 6, 2018
• Journal: BMJ Open
• Electronic ISSN: 2044-6055
• Publisher: BMJ Publishing Group
• Peer Reviewed: Peer Reviewed
• Volume: 8
• Issue: 7
• Article Number: e020269
• DOI: https://doi.org/10.1136/bmjopen-2017-020269
• Keywords: General Medicine
• Public URL: https://nottingham-repository.worktribe.com/output/952245
• Publisher URL: https://bmjopen.bmj.com/content/8/7/e020269