Validation of automated Alberta Stroke Program Early CT Score (ASPECTS) software for detection of early ischemic changes on non-contrast brain CT scans

Neuroradiology. 2021 Apr;63(4):491-498. doi: 10.1007/s00234-020-02533-6. Epub 2020 Aug 28.

Abstract

Purpose: In ASPECTS, 10 brain regions are scored visually for presence of acute ischemic stroke damage. We evaluated automated ASPECTS in comparison to expert readers.

Methods: Consecutive, baseline non-contrast CT-scans (5-mm slice thickness) from the prospective MR CLEAN trial (n = 459, MR CLEAN Netherlands Trial Registry number: NTR1804) were evaluated. A two-observer consensus for ASPECTS regions (normal/abnormal) was used as reference standard for training and testing (0.2/0.8 division). Two other observers provided individual ASPECTS-region scores. The Automated ASPECTS software was applied. A region score specificity of ≥ 90% was used to determine the software threshold for detection of an affected region based on relative density difference between affected and contralateral region. Sensitivity, specificity, and receiver-operating characteristic curves were calculated. Additionally, we assessed intraclass correlation coefficients (ICCs) for automated ASPECTS and observers in comparison to the reference standard in the test set.

Results: In the training set (n = 104), with software thresholds for a specificity of ≥ 90%, we found a sensitivity of 33-49% and an area under the curve (AUC) of 0.741-0.785 for detection of an affected ASPECTS region. In the test set (n = 355), the results for the found software thresholds were 89-89% (specificity), 41-57% (sensitivity), and 0.750-0.795 (AUC). Comparison of automated ASPECTS with the reference standard resulted in an ICC of 0.526. Comparison of observers with the reference standard resulted in an ICC of 0.383-0.464.

Conclusion: The performance of automated ASPECTS is comparable to expert readers and could support readers in the detection of early ischemic changes.

Keywords: Brain ischemia; Computer-Assisted; Image Processing; Software validation; Stroke; Tomography; X-Ray Computed.

Publication types

  • Multicenter Study
  • Randomized Controlled Trial

MeSH terms

  • Alberta
  • Brain
  • Brain Ischemia* / diagnostic imaging
  • Humans
  • Prospective Studies
  • Software
  • Stroke* / diagnostic imaging
  • Tomography, X-Ray Computed