Background: The NIH Stroke Scale (NIHSS) is a validated tool for assessing stroke severity, increasingly used by general practitioners in telemedicine services. Mobile apps may enhance its reliability. We aim to validate a digital platform (SPOKES) for NIHSS assessment in telemedicine and healthcare settings.
Methods: Hospitals using a telemedicine service were randomly allocated to control or SPOKES-user groups. The discrepancy between the NIHSS scores reported and those confirmed by experts was evaluated. Healthcare providers from comprehensive stroke centers were invited for interrater validation. Participants were randomized to assess the NIHSS using videos of real patients. Weighted Kappa (wk) statistics analyzed the agreement, and logistic regression determined the correlation with the congruency.
Results: A total of 299 telemedicine consultations from 12 hospitals were included. The difference between the NIHSS scores reported and double-checked was lower in the SPOKES group (p = 0.03), with a significantly higher level of complete agreement (72.5 % vs. 50.4 %, p = 0.005). Adoption of SPOKES was associated with complete congruency (OR 4.01, 95 %CI 1.42-11.35, p = 0.009). For interrater validation, 20 participants were considered. In the SPOKES group, almost-perfect and strong agreement occurred in 13.3 %(n = 6/45) and 84.4 %(n = 38/45) of ratings, respectively; in the control group, 6.7 %(n = 3/45) were almost-perfect, 28.9 %(n = 13/45) strong and 51 %(n = 23/45) were minimal.
Conclusion: A free and reliable mobile application for NIHSS assessment can significantly improve interrater agreement between healthcare professionals, and between NIHSS-certified neurologists and general practitioners. Our results underscore the importance of ongoing training and education in enhancing the consistency and reliability of NIHSS scores.
Keywords: Acute stroke; Digital health; NIH stroke scale; Telemedicine.
Copyright © 2024 Elsevier Inc. All rights reserved.