Development and evaluation of classifiers

Methods Mol Biol. 2007:404:89-116. doi: 10.1007/978-1-59745-530-5_6.

Abstract

Diagnostic tests, medical tests, screening tests, biomarkers, and prediction rules are all types of classifiers. This chapter introduces methods for classifier development and evaluation. We first introduce measures of classification performance including sensitivity, specificity, and receiver operating characteristic (ROC) curves. We then review some issues in the design of studies to assess and compare the performance of classifiers. Approaches for using the data to estimate and compare classifier accuracy are then introduced. Next, methods for combining multiple classifiers into a single classifier are presented. Lastly, we discuss other important aspects of classifier development and evaluation. The methods presented are illustrated with real data.

Publication types

  • Review

MeSH terms

  • Appendicitis / diagnostic imaging
  • Child
  • Diagnostic Tests, Routine*
  • Heart Diseases / diagnosis
  • Humans
  • Pancreatic Neoplasms / diagnosis
  • Predictive Value of Tests
  • ROC Curve
  • Reproducibility of Results
  • Sensitivity and Specificity
  • Statistics as Topic / methods*
  • Ultrasonography