Abstract
Predicting the Remaining Useful Life (RUL) holds a pivotal role in intelligent prognostics and health management strategies. Lightweight neural networks and micro neural networks are gradually becoming research hotspots due to their unique advantages in recent years. In this paper, we propose a lightweight physics-informed neural network model based on causal discovery (Cau-AttnPINN) for remaining useful life prediction. Specifically, causal discovery algorithms are employed to explore complex causal chains and feedback mechanisms among variables, selecting significant features for dimensionality reduction. Self-attention mechanisms are utilized to learn differences and interactions among important features for further dimensionality reduction, and the predictive interaction neural network (PINN) is utilized to map features to RUL. Its advantage lies in model lightweighting, reducing computational complexity and memory requirements. The proposed framework demonstrates commendable predictive accuracy and interpretability while utilizing fewer trainable parameters when tested on a real C-MAPSS benchmark dataset.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Shi, J.Y., et al.: A dual attention LSTM lightweight model based on exponential smoothing for remaining useful life prediction. Reliab. Eng. Syst. Saf. 243, 109821 (2024)
Liang, P., et al.: Remaining useful life prediction via a deep adaptive transformer framework enhanced by graph attention network. Int. J. Fatigue 174, 107722 (2023)
Mo, H., Iacca, G.: Evolutionary neural architecture search on transformers for RUL prediction. Mater. Manuf. Processes 38(15), 1–18 (2023)
Raissi, M., et al.: Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. J. Comput. Phys. 378, 686–707 (2019)
Cofre-Martel, S., et al.: Remaining useful life estimation through deep learning partial differential equation models: a framework for degradation dynamics interpretation using latent variables. Shock. Vib. 2021, 1–15 (2021)
Wen, P., et al.: Physics-informed neural networks for prognostics and health management of lithium-lon batteries. IEEE Trans. Intell. Veh., 1–14 (2023)
Liao, X., et al.: Remaining useful life with self-attention assisted physics-informed neural network. Adv. Eng. Inform. 58, 102195 (2023)
Neuberg, L.G.: Causality models, reasoning, and inference, By Judea Pearl, Cambridge university press. Econom. Theory 19(4), 675–685 (2003)
Spirtes, P.: An anytime algorithm for causal inference. In: International Workshop on Artificial Intelligence and Statistics. Proceedings of Machine Learning Research, pp. 278–285 (2001)
Ogarrio, J.M., et al.: A hybrid causal search algorithm for latent variable models. In: Conference on Probabilistic Graphical Models. Proceedings of Machine Learning Research, pp. 368–379 (2016)
Castri, L., et al.: Enhancing causal discovery from robot sensor data in dynamic scenarios. In: Conference on Causal Learning and Reasoning. Proceedings of Machine Learning Research, pp. 243–258 (2023)
Wang, L., et al.: CausalGNN: causal-based graph neural networks for spatio-temporal epidemic forecasting. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 11, pp. 12191–12199 (2022)
Duan, Z., et al.: Multivariate time series forecasting with transfer entropy graph. Tsinghua Sci. Technol. 28(1), 141–149 (2022)
Saxena, A., et al.: Damage propagation modeling for aircraft engine run-to-failure simulation. In: 2008 International Conference on Prognostics and Health Management, pp. 1–9. IEEE (2008)
Zheng, S., et al.: Long short-term memory network for remaining useful life estimation. In: Proceedings of the IEEE International Conference on Prognostics and Health Management (ICPHM), pp. 88–95. IEEE (2017)
Yu, W., et al.: An improved similarity-based prognostic algorithm for RUL estimation using an RNN auto encoder scheme. Reliab. Eng. Syst. Saf. 199, 106926 (2020)
Mo, Y., et al.: Remaining useful life estimation via transformer encoder enhanced by a gated convolutional unit. J. Intell. Manuf. 32(7), 1997–2006 (2021)
Natsumeda, M.: Remaining useful life estimation with end-to-end learning from long run-to-failure data. In: Annual Conference of the Society of Instrument and Control Engineers (SICE), pp. 542–547. IEEE (2022)
You, K., et al.: A 3D attention-enhanced hybrid neural network for turbofan engine remaining life prediction using CNN and BiLSTM models. IEEE Sens. J. (2023)
Acknowledgments
This paper is supported by the Tianjin Scientific Research Plan project (No. 23YDTPJC00470), and Tianjin Graduate Scientific Research Innovation project (No. 2022SKY124). In addition, the authors appreciate the valuable feedback from the reviewers.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Li, M., Cui, H., Luo, M., Ke, T. (2024). A Lightweight Physics-Informed Neural Network Model Based on Causal Discovery for Remaining Useful Life Prediction. In: Huang, DS., Si, Z., Zhang, C. (eds) Advanced Intelligent Computing Technology and Applications. ICIC 2024. Lecture Notes in Computer Science(), vol 14878. Springer, Singapore. https://doi.org/10.1007/978-981-97-5672-8_11
Download citation
DOI: https://doi.org/10.1007/978-981-97-5672-8_11
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-5671-1
Online ISBN: 978-981-97-5672-8
eBook Packages: Computer ScienceComputer Science (R0)Springer Nature Proceedings Computer Science
