A risk calculator to predict adult attention-deficit/hyperactivity disorder: generation and external validation in three birth cohorts and one clinical sample

Epidemiol Psychiatr Sci. 2019 May 15:29:e37. doi: 10.1017/S2045796019000283.

Abstract

Aim: Few personalised medicine investigations have been conducted for mental health. We aimed to generate and validate a risk tool that predicts adult attention-deficit/hyperactivity disorder (ADHD).

Methods: Using logistic regression models, we generated a risk tool in a representative population cohort (ALSPAC - UK, 5113 participants, followed from birth to age 17) using childhood clinical and sociodemographic data with internal validation. Predictors included sex, socioeconomic status, single-parent family, ADHD symptoms, comorbid disruptive disorders, childhood maltreatment, ADHD symptoms, depressive symptoms, mother's depression and intelligence quotient. The outcome was defined as a categorical diagnosis of ADHD in young adulthood without requiring age at onset criteria. We also tested Machine Learning approaches for developing the risk models: Random Forest, Stochastic Gradient Boosting and Artificial Neural Network. The risk tool was externally validated in the E-Risk cohort (UK, 2040 participants, birth to age 18), the 1993 Pelotas Birth Cohort (Brazil, 3911 participants, birth to age 18) and the MTA clinical sample (USA, 476 children with ADHD and 241 controls followed for 16 years from a minimum of 8 and a maximum of 26 years old).

Results: The overall prevalence of adult ADHD ranged from 8.1 to 12% in the population-based samples, and was 28.6% in the clinical sample. The internal performance of the model in the generating sample was good, with an area under the curve (AUC) for predicting adult ADHD of 0.82 (95% confidence interval (CI) 0.79-0.83). Calibration plots showed good agreement between predicted and observed event frequencies from 0 to 60% probability. In the UK birth cohort test sample, the AUC was 0.75 (95% CI 0.71-0.78). In the Brazilian birth cohort test sample, the AUC was significantly lower -0.57 (95% CI 0.54-0.60). In the clinical trial test sample, the AUC was 0.76 (95% CI 0.73-0.80). The risk model did not predict adult anxiety or major depressive disorder. Machine Learning approaches did not outperform logistic regression models. An open-source and free risk calculator was generated for clinical use and is available online at https://ufrgs.br/prodah/adhd-calculator/.

Conclusions: The risk tool based on childhood characteristics specifically predicts adult ADHD in European and North-American population-based and clinical samples with comparable discrimination to commonly used clinical tools in internal medicine and higher than most previous attempts for mental and neurological disorders. However, its use in middle-income settings requires caution.

Keywords: Attention-deficit hyperactivity disorder; child psychiatry; epidemiology; risk factors; statistics.

Publication types

  • Validation Study

MeSH terms

  • Adolescent
  • Area Under Curve
  • Attention Deficit Disorder with Hyperactivity / epidemiology*
  • Attention Deficit Disorder with Hyperactivity / psychology
  • Attention Deficit and Disruptive Behavior Disorders / epidemiology
  • Attention Deficit and Disruptive Behavior Disorders / psychology
  • Child
  • Child Abuse / statistics & numerical data*
  • Cohort Studies
  • Conduct Disorder / epidemiology*
  • Conduct Disorder / psychology
  • Depression / epidemiology*
  • Depression / psychology
  • Depressive Disorder
  • Female
  • Humans
  • Intelligence Tests
  • Intelligence*
  • Logistic Models
  • Male
  • Mothers / psychology
  • Prospective Studies
  • Reproducibility of Results
  • Risk Assessment
  • Sex Factors
  • Single-Parent Family / statistics & numerical data*
  • Social Class*
  • United Kingdom / epidemiology
  • Young Adult