An external validation study of a clinical prediction rule for medical patients with suspected bacteraemia

Emerg Med J. 2016 Feb;33(2):124-9. doi: 10.1136/emermed-2015-204926. Epub 2015 Aug 5.

Abstract

Objective: The objective of this study was to externally validate a clinical prediction rule (CPR)-the 'Shapiro criteria'-to predict bacteraemia in an acute medical unit (AMU).

Methods: Prospectively collected data, retrospectively evaluated over 11 months in an AMU in the UK. From 4810 admissions, 635 patients (13%) had blood cultures (BCs) performed. The 100 cases of true bacteraemia were compared with a randomly selected sample of 100 control cases where BCs were sterile.

Results: To predict bacteraemia (at a cut-off score of two points), the Shapiro criteria had a sensitivity of 97% (95% CIs 91% to 99%), specificity 37% (28% to 47%), positive likelihood ratio 1.54 (1.3 to 1.8) and a negative likelihood ratio of 0.08 (0.03 to 0.25). The area under the receiver operating curve was 0.80 (0.74 to 0.86), and the Hosmer-Lemeshow p value was 0.45.

Conclusions: A cut-off score of two points on the Shapiro criteria had high sensitivity to predict bacteraemia in a study of acute general medical admissions. Application of the rule in patients being considered for a BC could identify those at low risk of bacteraemia. Though the model demonstrated good discrimination, the lengthy number of variables (13) and difficulty automating the CPR may limit its use.

Keywords: bacterial; infectious diseases.

Publication types

  • Validation Study

MeSH terms

  • Aged
  • Bacteremia / diagnosis*
  • Case-Control Studies
  • Decision Support Techniques*
  • England
  • Female
  • Humans
  • Male
  • Middle Aged
  • Retrospective Studies
  • Sensitivity and Specificity