Chen, Chong, Wang, Tao, Liu, Chao, Liu, Yuxin and Cheng, Lianglun (2023). Lightweight Convolutional Transformers Enhanced Meta Learning for Compound Fault Diagnosis of Industrial Robot. IEEE Transactions on Instrumentation and Measurement, 72 ,
Abstract
Recent advance of deep learning has seen remarkable progress in compound fault diagnosis modeling for industrial robots. Nevertheless, the data scarcity of compound fault samples jeopardizes the modeling performance of deep learning algorithms. Meta-learning has become an effective tool in few-shot fault diagnosis modeling. However, due to the training instability of meta-learning, it is challenging to deploy advanced networks such as transformers as the base learner due to the extremely large model size. Therefore, this study proposes a lightweight convolutional transformers (LCT) network enhanced meta-learning (Meta-LCT) method to achieve accurate compound fault diagnosis with limited compound fault samples. Specifically, the LCT is first designed by taking the advantage of linear spatial reduction (LSR) attention and spatial pooling mechanism to achieve high computational efficiency. LCT is adopted as the base learner in the Meta-stochastic gradient descent (SGD) algorithm, and then, the meta-training is performed based on the single fault data. Subsequently, the limited compound fault samples are used in the meta testing stage to obtain a compound fault diagnosis model. An experimental study based on the real-world compound fault dataset of industrial robots is presented. The experimental results indicate that the proposed Meta-LCT can achieve the compound fault diagnosis accuracy of 81.1% when only 40 data samples in each compound fault category are available.
Publication DOI: | https://doi.org/10.1109/tim.2023.3277956 |
---|---|
Divisions: | College of Engineering & Physical Sciences > School of Engineering and Technology > Mechanical, Biomedical & Design College of Engineering & Physical Sciences > Smart and Sustainable Manufacturing |
Additional Information: | Copyright © 2023 IEEE. Personal use is permitted, Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Funding Information: This work was supported in part by the Key Program of NSFC-Guangdong Joint Funds under Grant U2001201 and Grant U1801263, in part by the Industrial Core and Key Technology Plan of Zhuhai City under Grant ZH22044702190034HJL, in part by the Natural Science Foundation of Guangdong Province under Grant 2020B1515120010, and in part by the Guangdong Provincial Key Laboratory of Cyber-Physical System under Grant 2020B1212060069. |
Uncontrolled Keywords: | Compound fault diagnosis,Compounds,Deep learning,Fault diagnosis,Feature extraction,Industrial robot,Industrial robots,Meta learning,Task analysis,Training,Transformers,Transformers networks,Instrumentation,Electrical and Electronic Engineering |
Publication ISSN: | 0018-9456 |
Last Modified: | 06 Aug 2024 09:48 |
Date Deposited: | 19 Jun 2023 12:06 |
Full Text Link: | |
Related URLs: |
https://ieeexpl ... cument/10138459
(Publisher URL) http://www.scop ... tnerID=8YFLogxK (Scopus URL) |
PURE Output Type: | Article |
Published Date: | 2023-05-29 |
Published Online Date: | 2023-05-29 |
Accepted Date: | 2023-05-08 |
Authors: |
Chen, Chong
Wang, Tao Liu, Chao ( ![]() Liu, Yuxin Cheng, Lianglun |