Explaining time series classifiers through meaningful perturbation and optimisation

Meng, Han; Wagner, Christian; Triguero, Isaac

Abstract

Machine learning approaches have enabled increasingly powerful time series classifiers. While performance has improved drastically, the resulting classifiers generally suffer from poor explainability, limiting their applicability in critical areas. Saliency-based methods designed to highlight the critical features are one of the most promising approaches to improving this explainability. Here, current techniques commonly rely on artificially perturbing the features, using, for example, random noise or ‘zeroing’ these features. We first demonstrate that an important drawback of these methods is that the perturbations used can result in unrealistic assessments of the classifier, since the perturbations force the data outside their original distribution. We articulate how this can result in poor identification of critical features, and hence misleading explanations. In order to address this issue and identify the most important features for the output of a black-box model, we propose a dual approach through meaningful perturbation and optimisation. First, leveraging a mechanism originally proposed in image analysis, a generative model is trained to create within-distribution perturbations of the input. These are then used to reliably evaluate whether a set of features is critical. Second, a greedy-based segmentation and identification strategy is proposed to search for the smallest set of critical features. Experiments show that the proposed approach addresses the out-of-distribution problem and identifies fewer critical features than existing methods. In combination, both aspects of the proposed approach offer a qualitative advance towards generating meaningful and robust explanations in the context of time series classification.

Citation

Meng, H., Wagner, C., & Triguero, I. (2023). Explaining time series classifiers through meaningful perturbation and optimisation. Information Sciences, 645, Article 119334. https://doi.org/10.1016/j.ins.2023.119334

• Journal Article Type: Article
• Acceptance Date: Jun 16, 2023
• Online Publication Date: Jun 26, 2023
• Publication Date: Oct 1, 2023
• Deposit Date: Jul 5, 2023
• Publicly Available Date: Jul 5, 2023
• Journal: Information Sciences
• Print ISSN: 0020-0255
• Electronic ISSN: 1872-6291
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 645
• Article Number: 119334
• DOI: https://doi.org/10.1016/j.ins.2023.119334
• Keywords: Time series classification; Post-hoc explanation; Saliency-based explanation; Perturbation method; Optimisation approach
• Public URL: https://nottingham-repository.worktribe.com/output/22186569
• Publisher URL: https://www.sciencedirect.com/science/article/pii/S0020025523009192
• Additional Information: This article is maintained by: Elsevier; Article Title: Explaining Time Series Classifiers through Meaningful Perturbation and Optimisation; Journal Title: Information Sciences; CrossRef DOI link to publisher maintained version: https://doi.org/10.1016/j.ins.2023.119334; Content Type: article; Copyright: © 2023 The Author(s). Published by Elsevier Inc.