An Automated Performance Evaluation of the Newborn Life Support Procedure

Tan, aAlfian; Egede, Joy; Remenyte-Prescott, Rasa; Valstar, Michel; Sharkey, Don

Abstract

This research is conducted to develop an automated action recognition method to evaluate the performance of the Newborn Life Support (NLS) procedure. It will be useful to find deviations in the procedure, such as missing steps and incorrect actions, which will reflect the reliability of the performing protocol. This method is also part of the work towards its integration with the NLS reliability model. A combination of image segmentation and action classification methods is used. The U-net Deep Learning model is trained to do segmentation on 18 objects. Every 150 consecutive segmented video frames are then grouped for action analysis. Four types of handcrafted features are extracted from every grouped image. A training strategy using traditional Machine Learning models is developed to deal with an imbalanced dataset, as well as to reduce the complexity of the system. The predicted action segment is visually examined to make sure of its practicality. Results show that the NLS first step of wet towel removal was correctly recognized in 23 of 23 videos (52.2%), indicating the potential usefulness of the model in determining if this critical action is performed correctly and at the right time.

Citation

Tan, A., Egede, J., Remenyte-Prescott, R., Valstar, M., & Sharkey, D. (2024, January). An Automated Performance Evaluation of the Newborn Life Support Procedure. Presented at 2024 Annual Reliability and Maintainability Symposium (RAMS), Albuquerque, NM, USA

• Presentation Conference Type: Edited Proceedings
• Conference Name: 2024 Annual Reliability and Maintainability Symposium (RAMS)
• Start Date: Jan 22, 2024
• End Date: Jan 25, 2024
• Acceptance Date: Oct 30, 2023
• Online Publication Date: Mar 18, 2024
• Publication Date: Jan 22, 2024
• Deposit Date: Jun 13, 2024
• Publicly Available Date: Jun 13, 2024
• Publisher: Institute of Electrical and Electronics Engineers
• Book Title: 2024 Annual Reliability and Maintainability Symposium (RAMS)
• ISBN: 9798350307702
• DOI: https://doi.org/10.1109/rams51492.2024.10457793
• Public URL: https://nottingham-repository.worktribe.com/output/33282483
• Publisher URL: https://ieeexplore.ieee.org/document/10457793