Evaluation of intervention fidelity of a complex psychosocial intervention Lifestyle Matters: A randomised controlled trial

Sprange, Kirsty; Mountain, Gail; Craig, Claire

Abstract

Objectives: Robust research of complex interventions designed to promote mental well-being in later life is required to inform service development. An essential component is ensuring that such interventions are delivered as intended. We present a detailed description of the design and implementation of a fidelity assessment within a trial of one such intervention (Lifestyle Matters). The findings help to explain the trial results and also inform the design of embedded fidelity assessments within future evaluations of complex interventions.

Design: We conducted a mixed-method fidelity assessment embedded as part of a multicentre pragmatic randomised controlled trial. A conceptual fidelity framework was developed from the Behaviour Change Consortium framework. From this the fidelity assessment was designed. The resulting instrument assessed the following parameters: intervention design, training, supervision; and delivery, receipt and enactment of the intervention.

Intervention: The Lifestyle Matters intervention was designed to assist older people to improve and sustain mental well-being through participation in meaningful activity. The aim is to enable participants to engage in both new and neglected activities through a mix of facilitated group meetings and individual sessions.

Results: The fidelity assessment demonstrated that the intervention was delivered as per protocol for the group component and was tailored to meet individual needs. There was substantial inter-rater agreement for training; and group member performance 0.72; and moderate agreement for facilitator performance 0.55. It was not possible to determine whether small declines seen in facilitator performance were due to facilitator drift or moderating factors such as group dynamics or participant characteristics.

Conclusions: The assessment methods adequately measured criteria identified as being significant indicators of fidelity. Adherence during training, delivery and supervision was good. The subjective nature of identification and rating observed behaviours was the main challenge. Future research should explore alternative methods of assessing fidelity in trials of complex interventions.

Citation

Sprange, K., Mountain, G., & Craig, C. (2021). Evaluation of intervention fidelity of a complex psychosocial intervention Lifestyle Matters: A randomised controlled trial. BMJ Open, 11(4), Article e043478. https://doi.org/10.1136/bmjopen-2020-043478

• Journal Article Type: Article
• Acceptance Date: Mar 24, 2021
• Online Publication Date: Apr 8, 2021
• Publication Date: Apr 8, 2021
• Deposit Date: Apr 12, 2021
• Publicly Available Date: Apr 16, 2021
• Journal: BMJ Open
• Electronic ISSN: 2044-6055
• Publisher: BMJ Publishing Group
• Peer Reviewed: Peer Reviewed
• Volume: 11
• Issue: 4
• Article Number: e043478
• DOI: https://doi.org/10.1136/bmjopen-2020-043478
• Keywords: General Medicine
• Public URL: https://nottingham-repository.worktribe.com/output/5438320
• Publisher URL: https://bmjopen.bmj.com/content/11/4/e043478