Reliability and validity of intervention characteristic measures for assessing barriers to evidence-based practice use

Abstract

Assessing barriers before implementing an evidence-based practice can increase the chances of successful implementation. This project evaluated measures of intervention characteristics that could affect implementation: evidence strength and quality; relative advantage; adaptability; trialability; complexity; design quality and packaging; perceived cost; compatibility; observability; risk; and burden. Measures (109 items total) for each intervention characteristic were developed in a previous study, using prior measures, and expert feedback. Measures were scored such that higher scores meant a more positive view. Healthcare personnel implementing a new practice (n = 175) completed two surveys, 1 month apart. Participants completed the intervention characteristic item banks and questions on the use of the evidence-based practice. Reliability and validity were assessed for each item bank. All measures had Cronbach's alphas over 0.7 (range: 0.700-0.932) indicating good reliability. Frequent users of the practice reported better levels of each determinant at the first (Cohen's d range: -0.239 to -0.687) and second surveys (Cohen's d range: -0.043 to -1.081) except for costs (0.096) with use on the second survey. This preliminary test of measures to assess determinants of implementing evidence-based practice supports the validity and reliability of these tools. Additional studies are needed to further test the psychometric properties of the measures and develop short forms of each intervention characteristic measure.

Keywords: barriers; determinants; facilitators.