Convolutional feature extraction for process monitoring using ultrasonic sensors

Bowler, Alexander; Pound, Michael; Watson, Nicholas

Abstract

Ultrasonic sensors are a low-cost and in-line technique and can be combined with machine learning for industrial process monitoring. However, training accurate machine learning models for process monitoring using sensor data is dependant on the feature selection methodology. This paper compares a convolutional feature extraction method to a traditional, coarse feature engineering approach. The convolutional method uses filter weights pre-trained on an auxiliary task to classify ultrasonic waveform dataset membership using previously obtained sensor data. The filter weights are used to extract features from the ultrasonic waveform. Principal component analysis is then applied to produce five principal components to be input into long short-term memory neural networks. The two approaches are compared on fermentation, mixing and cleaning datasets monitored using ultrasonic sensors. Overall, the convolutional feature method produced more informative waveform features than the coarse feature engineering approach, achieving higher model accuracy for datasets requiring substantial waveform information and for 65% of tasks overall. Multi-task learning also improved feature trajectory learning but led to reduced model accuracy for data points far from the classification decision boundaries. This can be overcome by further optimisation of neural network hyperparameters, though at increased model development time. Once trained, the convolutional feature extraction approach is a fast and convenient way of producing high quality features from ultrasonic waveforms using convolutional neural networks with little training data.

Citation

Bowler, A., Pound, M., & Watson, N. (2021). Convolutional feature extraction for process monitoring using ultrasonic sensors. Computers and Chemical Engineering, 155, Article 107508. https://doi.org/10.1016/j.compchemeng.2021.107508

• Journal Article Type: Article
• Acceptance Date: Aug 26, 2021
• Online Publication Date: Aug 28, 2021
• Publication Date: Dec 1, 2021
• Deposit Date: Sep 27, 2021
• Publicly Available Date: Aug 29, 2022
• Journal: Computers and Chemical Engineering
• Print ISSN: 0098-1354
• Publisher: Elsevier BV
• Peer Reviewed: Peer Reviewed
• Volume: 155
• Article Number: 107508
• DOI: https://doi.org/10.1016/j.compchemeng.2021.107508
• Keywords: Computer Science Applications; General Chemical Engineering
• Public URL: https://nottingham-repository.worktribe.com/output/6343006
• Publisher URL: https://www.sciencedirect.com/science/article/abs/pii/S0098135421002866?via%3Dihub
• Additional Information: This article is maintained by: Elsevier; Article Title: Convolutional feature extraction for process monitoring using ultrasonic sensors; Journal Title: Computers & Chemical Engineering; CrossRef DOI link to publisher maintained version: https://doi.org/10.1016/j.compchemeng.2021.107508