Huanlai Xing
An Efficient Federated Distillation Learning System for Multitask Time Series Classification
Xing, Huanlai; Xiao, Zhiwen; Qu, Rong; Zhu, Zonghai; Zhao, Bowen
Authors
Abstract
This paper proposes an efficient federated distillation learning system (EFDLS) for multi-task time series classification (TSC). EFDLS consists of a central server and multiple mobile users, where different users may run different TSC tasks. EFDLS has two novel components: a feature-based student-teacher (FBST) framework and a distance-based weights matching (DBWM) scheme. For each user, the FBST framework transfers knowledge from its teacher’s hidden layers to its student’s hidden layers via knowledge distillation, where the teacher and student have identical network structures. For each connected user, its student model’s hidden layers’ weights are uploaded to the EFDLS server periodically. The DBWM scheme is deployed on the server, with the least square distance used to measure the similarity between the weights of two given models. This scheme finds a partner for each connected user such that the user’s and its partner’s weights are the closest among all the weights uploaded. The server exchanges and sends back the user’s and its partner’s weights to these two users which then load the received weights to their teachers’ hidden layers. Experimental results show that compared with a number of state-of-the-art federated learning algorithms, our proposed EFDLS wins 20 out of 44 standard UCR2018 datasets and achieves the highest mean accuracy (70.14%) on these datasets. In particular, compared with a single-task Baseline, EFDLS obtains 32/4/8 regarding ’win’/’tie’/’lose’ and results in an improvement of approximately 4% in terms of mean accuracy.
Citation
Xing, H., Xiao, Z., Qu, R., Zhu, Z., & Zhao, B. (2022). An Efficient Federated Distillation Learning System for Multitask Time Series Classification. IEEE Transactions on Instrumentation and Measurement, 71, https://doi.org/10.1109/TIM.2022.3201203
Journal Article Type | Article |
---|---|
Acceptance Date | Aug 13, 2022 |
Online Publication Date | Aug 24, 2022 |
Publication Date | Aug 24, 2022 |
Deposit Date | Aug 30, 2022 |
Publicly Available Date | Sep 2, 2022 |
Journal | IEEE Transactions on Instrumentation and Measurement |
Print ISSN | 0018-9456 |
Electronic ISSN | 1557-9662 |
Publisher | Institute of Electrical and Electronics Engineers |
Peer Reviewed | Peer Reviewed |
Volume | 71 |
DOI | https://doi.org/10.1109/TIM.2022.3201203 |
Keywords | Electrical and Electronic Engineering, Instrumentation |
Public URL | https://nottingham-repository.worktribe.com/output/10367872 |
Publisher URL | https://ieeexplore.ieee.org/document/9865987 |
Files
IEEE TIM Federated Learning Multi-task Time Series
(5.9 Mb)
PDF
You might also like
A graph-based hyper heuristic for timetabling problems
(2007)
Journal Article
A path-oriented encoding evolutionary algorithm for network coding resource minimization
(2013)
Journal Article
Downloadable Citations
About Repository@Nottingham
Administrator e-mail: discovery-access-systems@nottingham.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search