Development and validation of metrics for assessment of ultrasound-guided fascial block skills

McLeod, Graeme; Seeley, Jonathan; Wilson, Matthew; Hind, Daniel; Cole, Ashley; Hewson, David; Hyslop, Marie; Keetharuth, Anju; MacFarlane, Alan; Wilby, Martin; McKendrick, Mel; McKendrick, Gary; Mustafa, Ayman; Chuan, Alwin; Bangalore, Pavan Raju; Record, Nicholas; Rombach, Ines; Sadler, Amy; Swaby, Liz; Taylor, Alasdair; Tripathi, Shiva

Abstract

Background

As few anaesthetists provide lumbar erector spinae block for disc surgery, there is a need to provide training to enable a randomised controlled trial investigating analgesia after painful spinal surgery (NIHR153170). The primary objective of the study was to develop and measure the construct validity of a checklist for assessment of skills in performing lumbar and thoracic erector spinae fascial plane injection using soft-embalmed Thiel cadavers.

Methods

Twenty-four UK consultant regional anaesthetists completed two iterations of a Delphi questionnaire. The final checklist consisted of 11 steps conducive to best practice. Thereafter, we validated the checklist by comparing the performance of 12 experts with 12 novices, each performing lumbar and thoracic erector spinae plane injections or fascia iliaca, serrato-pectoral (PEC II) and serratus injections, randomly allocated to the left and right sides of six soft-embalmed Thiel cadavers. Six expert, trained raters blinded to operator and site of block examined 120 videos each.

Results

The mean (95% confidence interval) internal consistency of the 11-item checklist for erector spinae plane injection was 0.72 (0.63–0.79) and interclass correlation was 0.88 (0.82–0.93). The checklist showed construct validity for lumbar and thoracic erector spinae injection, experts vs novices {median (interquartile range [range]) 8.0 (7.0–10.0 [1–11]) vs 7.0 (5.0–9.0 [4–11]), difference 1.5 (1.0–2.5), P<0.001}. Global rating scales showed construct validity for lumbar and thoracic erector spinae injection, 28.0 (24.0–31.0 [7–35]) vs 21.0 (17.0–24.0 [7–35]), difference 7.5 (6.0–8.5), P<0.001. The most difficult items to perform were identifying the needle tip before advancing and always visualising the needle tip. Instrument handling and flow of procedure were the areas of greatest difficulty on the global rating scale (GRS). Checklists and GRS scores correlated. There was homogeneity of regression slopes controlling for status, type of injection, and rater. Generalisability analysis showed a high reliability using the checklist and GRS for all fascial plane blocks (Rho [ρ2] 0.93–0.96: Phi [ϕ] 0.84–0.87).

Conclusions

An 11-point checklist developed through a modified Delphi process to provide best practice guidance for fascial plane injection showed construct validity in performing lumbar and thoracic erector spinae fascial plane injection in soft-embalmed Thiel cadavers.

Citation

McLeod, G., Seeley, J., Wilson, M., Hind, D., Cole, A., Hewson, D., Hyslop, M., Keetharuth, A., MacFarlane, A., Wilby, M., McKendrick, M., McKendrick, G., Mustafa, A., Chuan, A., Bangalore, P. R., Record, N., Rombach, I., Sadler, A., Swaby, L., Taylor, A., & Tripathi, S. (2024). Development and validation of metrics for assessment of ultrasound-guided fascial block skills. British Journal of Anaesthesia, 133(4), 862-873. https://doi.org/10.1016/j.bja.2024.06.039

• Journal Article Type: Article
• Acceptance Date: Jun 7, 2024
• Online Publication Date: Aug 8, 2024
• Publication Date: Oct 1, 2024
• Deposit Date: May 29, 2025
• Journal: British Journal of Anaesthesia
• Print ISSN: 0007-0912
• Electronic ISSN: 1471-6771
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 133
• Issue: 4
• Pages: 862-873
• DOI: https://doi.org/10.1016/j.bja.2024.06.039
• Keywords: fascial plane, cadaver, regional anaesthesia, training, lumbar spine, erector spinae
• Public URL: https://nottingham-repository.worktribe.com/output/38897569
• Publisher URL: https://www.sciencedirect.com/science/article/pii/S0007091224004227?via%3Dihub#sec6
• Additional Information: This article is maintained by: Elsevier; Article Title: Development and validation of metrics for assessment of ultrasound-guided fascial block skills☆; Journal Title: British Journal of Anaesthesia; CrossRef DOI link to publisher maintained version: https://doi.org/10.1016/j.bja.2024.06.039; Content Type: article; Copyright: © 2024 British Journal of Anaesthesia. Published by Elsevier Ltd. All rights are reserved, including those for text and data mining, AI training, and similar technologies.