Evaluating artificial intelligence software for delineating hemorrhage extent on CT brain imaging in stroke: AI delineation of ICH on CT

J Stroke Cerebrovasc Dis. 2024 Jan;33(1):107512. doi: 10.1016/j.jstrokecerebrovasdis.2023.107512. Epub 2023 Nov 25.

Abstract

Background: The extent and distribution of intracranial hemorrhage (ICH) directly affects clinical management. Artificial intelligence (AI) software can detect and may delineate ICH extent on brain CT. We evaluated e-ASPECTS software (Brainomix Ltd.) performance for ICH delineation.

Methods: We qualitatively assessed software delineation of ICH on CT using patients from six stroke trials. We assessed hemorrhage delineation in five compartments: lobar, deep, posterior fossa, intraventricular, extra-axial. We categorized delineation as excellent, good, moderate, or poor. We assessed quality of software delineation with number of affected compartments in univariate analysis (Kruskall-Wallis test) and ICH location using logistic regression (dependent variable: dichotomous delineation categories 'excellent-good' versus 'moderate-poor'), and report odds ratios (OR) and 95 % confidence intervals (95 %CI).

Results: From 651 patients with ICH (median age 75 years, 53 % male), we included 628 with assessable CTs. Software delineation of ICH extent was 'excellent' in 189/628 (30 %), 'good' in 255/628 (41 %), 'moderate' in 127/628 (20 %), and 'poor' in 57/628 cases (9 %). The quality of software delineation of ICH was better when fewer compartments were affected (Z = 3.61-6.27; p = 0.0063). Software delineation of ICH extent was more likely to be 'excellent-good' quality when lobar alone (OR = 1.56, 95 %CI = 0.97-2.53) but 'moderate-poor' with any intraventricular (OR = 0.56, 95 %CI = 0.39-0.81, p = 0.002) or any extra-axial (OR = 0.41, 95 %CI = 0.27-0.62, p<0.001) extension.

Conclusions: Delineation of ICH extent on stroke CT scans by AI software was excellent or good in 71 % of cases but was more likely to over- or under-estimate extent when ICH was either more extensive, intraventricular, or extra-axial.

Keywords: Artificial intelligence; CT; Hemorrhage; Stroke.

MeSH terms

  • Aged
  • Artificial Intelligence
  • Cerebral Hemorrhage* / diagnostic imaging
  • Female
  • Humans
  • Intracranial Hemorrhages / diagnostic imaging
  • Male
  • Neuroimaging
  • Software
  • Stroke* / diagnostic imaging
  • Tomography, X-Ray Computed