The adaptation and fidelity tool to support social service practitioners in balancing fidelity and adaptations: Longitudinal, mixed-method evaluation study

Implement Res Pract. 2023 Jul 30:4:26334895231189198. doi: 10.1177/26334895231189198. eCollection 2023 Jan-Dec.

Abstract

Background: Evidence-based interventions (EBIs) seldom fit seamlessly into a setting and are often adapted. The literature identifies practitioners' management of fidelity and adaptations as problematic but offers little guidance. This study aimed to investigate practitioners' perceptions of the feasibility and usability of an intervention aimed to support them in fidelity and adaptation management when working with EBIs.

Methods: The intervention, the adaptation and fidelity tool (A-FiT), was developed based on the literature, along with input from social service practitioners and social services' Research and Development units' personnel. The intervention consisted of two workshops where the participants were guided through a five-step process to manage fidelity and adaptations. It was tested in a longitudinal mixed-method intervention study with 103 practitioners from 19 social service units in Stockholm, Sweden. A multimethod data collection was employed, which included interviews at follow-up, questionnaires at baseline and follow-up (readiness for change and self-rated knowledge), workshop evaluation questionnaires (usability and feasibility) after each workshop, and documentation (participants' notes on worksheets). To analyze the data, qualitative content analysis, Kruskal-Wallis tests, and Wilcoxon rank-sum tests were performed.

Results: Overall, the practitioners had a positive perception of the intervention and perceived it as relevant for fidelity and adaptation management (mean ratings over 7.0 on usability and feasibility). The workshops also provided new knowledge and skills to manage fidelity and adaptations. Furthermore, the intervention provided insights into the practitioners' understanding about adaptation and fidelity through a more reflective approach.

Conclusion: Practical tools are needed to guide professionals not only to adhere to intervention core elements but also to help them to manage fidelity and adaptation. The proposed A-FiT intervention for practitioners' management of both fidelity and adaptation is a novel contribution to the implementation literature. Potentially, the next step is an evaluation of the intervention's impact in an experimental design.

Keywords: adaptation; evidence-based; mixed methods (qualitative and quantitative) evaluation; practice context; treatment adherence; treatment fidelity; use of evidence.

Plain language summary

This study describes practitioners’ perceptions of an intervention that aims to support them in fidelity and adaptation management when working with evidence-based interventions (EBIs). This is an important issue because social services practitioners are expected to use EBIs that seldom fit seamlessly into a specific setting and are often adapted. The practitioners perceived the intervention as relevant for their fidelity and adaptation management and states that it helped them develop a plan and increased their knowledge on the topic. Professionals require practical guiding tools not only to adhere to intervention content but also to balance them with fidelity and adaptation. This proposed intervention for practitioners’ management of both fidelity and adaptation is a novel contribution to the implementation literature. We propose that researchers further evaluate this intervention as a potential next step.