Puzzling findings in studying the outcome of "real world" adolescent mental health services: the TRAILS study

PLoS One. 2012;7(9):e44704. doi: 10.1371/journal.pone.0044704. Epub 2012 Sep 19.

Abstract

Background: The increased use and costs of specialist child and adolescent mental health services (MHS) urge us to assess the effectiveness of these services. The aim of this paper is to compare the course of emotional and behavioural problems in adolescents with and without MHS use in a naturalistic setting.

Method and findings: Participants are 2230 (pre)adolescents that enrolled in a prospective cohort study, the TRacking Adolescents' Individual Lives Survey (TRAILS). Response rate was 76%, mean age at baseline 11.09 (SD 0.56), 50.8% girls. We used data from the first three assessment waves, covering a six year period. Multiple linear regression analysis, propensity score matching, and data validation were used to compare the course of emotional and behavioural problems of adolescents with and without MHS use. The association between MHS and follow-up problem score (β 0.20, SE 0.03, p-value<0.001) was not confounded by baseline severity, markers of adolescent vulnerability or resilience nor stressful life events. The propensity score matching strategy revealed that follow-up problem scores of non-MHS-users decreased while the problem scores of MHS users remained high. When taking into account future MHS (non)use, it appeared that problem scores decreased with limited MHS use, albeit not as much as without any MHS use, and that problem scores with continuous MHS use remained high. Data validation showed that using a different outcome measure, multiple assessment waves and multiple imputation of missing values did not alter the results. A limitation of the study is that, although we know what type of MHS participants used, and during which period, we lack information on the duration of the treatment.

Conclusions: The benefits of MHS are questionable. Replication studies should reveal whether a critical examination of everyday care is necessary or an artefact is responsible for these results.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adolescent
  • Adolescent Health Services*
  • Child
  • Cohort Studies
  • Female
  • Humans
  • Linear Models
  • Male
  • Mental Health Services*
  • Outcome Assessment, Health Care
  • Prospective Studies

Grants and funding

This research is part of the TRacking Adolescents' Individual Lives Survey (TRAILS). Participating centres of TRAILS include various departments of the University Medical Centre and University of Groningen, the Erasmus University Medical Centre Rotterdam, the University of Utrecht, the Radboud Medical Centre Nijmegen, and the Parnassia Bavo group, all in the Netherlands. TRAILS has been financially supported by various grants from the Netherlands Organization for Scientific Research NWO (Medical Research Council program grant GB-MW 940-38-011; ZonMW Brainpower grant 100-001-004; ZonMw Risk Behavior and Dependence grants 60-60600-98-018 and 60-60600-97-118; ZonMw Culture and Health grant 261-98-710; Social Sciences Council medium-sized investment grants GB-MaGW 480-01-006 and GB-MaGW 480-07-001; Social Sciences Council project grants GB-MaGW 457-03-018, GB-MaGW 452-04-314, and GB-MaGW 452-06-004; NWO large-sized investment grant 175.010.2003.005; NWO Longitudinal Survey and Panel Funding 481-08-013); the Sophia Foundation for Medical Research (projects 301 and 393), the Dutch Ministry of Justice (WODC), the European Science Foundation (EuroSTRESS project FP-006), and the participating universities. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.