Document Type : Research Paper


Electrical Engineering Department, Collage of Engineering, University of Mosul, Mosul, Iraq


The fault diagnosis of electric vehicle motors is one of the exciting topics, and machine learning-based artificial intelligence proved its worth in this field. The primitive methods of machine learning, such as the support vector machine (SVM) and Artificial nural network (ANN) suffered from feature extraction problems, the efficiency of the system depended on the quality of these extracted features until deep learning and deep neural networks came to solve This problem, Although the efficient performance of the deep neural network, it needs excellent experience in selecting parameters and building the structure of the neural network. The emergence of deep reinforcement learning, capable of handling raw data directly and constructing end-to-end systems to link raw fault data with its corresponding mode, represents a significant advancement in the field of machine learning. Furthermore, deep reinforcement learning exhibits greater intelligence compared to previous methods. In this Research, Deep reinforcement learning will be applied in diagnosing inter-turn short circuit faults and finding the level of fault in the built-in wheel permanent magnet synchronous motor of electric vehicles. The proposed method proved highly effective for detecting faults, with an efficiency of 99.9 % and has a promising future in building a general system capable of predicting faults in the early stages.


Main Subjects

  1. W. Najem, O. Al-Yozbaky, and S. Khudher, “Effect of Electric Vehicle Charging Stations on the Performance of Distance Relay,” Al-Rafidain Eng. J., vol. 28, no. 1, pp. 133–144, 2023, doi: 10.33899/rengj.2022.135233.1194.
  2. G. Hill, O. Heidrich, F. Creutzig, and P. Blythe, “The role of electric vehicles in near-term mitigation pathways and achieving the UK’s carbon budget,” Appl. Energy, vol. 251, Oct. 2019, doi: 10.1016/j.apenergy.2019.04.107.
  3. J. A. Sanguesa, V. Torres-Sanz, P. Garrido, F. J. Martinez, and J. M. Marquez-Barja, “A review on electric vehicles: Technologies and challenges,” Smart Cities, vol. 4, no. 1. MDPI, pp. 372–404, Mar. 01, 2021. doi: 10.3390/smartcities4010022.
  4. Z. Cao, A. Mahmoudi, S. Kahourzade, and W. L. Soong, “An Overview of Electric Motors for Electric Vehicles,” in Proceedings of 2021 31st Australasian Universities Power Engineering Conference, AUPEC 2021, Institute of Electrical and Electronics Engineers Inc., 2021. doi: 10.1109/AUPEC52110.2021.9597739.
  5. B. M. Saied and L. A. Mohammed, “Permanent Magnet Synchronous Motor Drive Based on Modified Space Vector Pulse Width Modulation,” AL-Rafdain Eng. J., vol. 22, no. 4, pp. 74–87, 2014, doi: 10.33899/rengj.2014.100886.
  6. M. Zafarani, E. Bostanci, Y. Qi, T. Goktas, and B. Akin, “Interturn short-circuit faults in permanent magnet synchronous machines: An extended review and comprehensive analysis,” IEEE Journal of Emerging and Selected Topics in Power Electronics, vol. 6, no. 4. Institute of Electrical and Electronics Engineers Inc., pp. 2173–2191, Dec. 01, 2018. doi: 10.1109/JESTPE.2018.2811538.
  7. S. S. Moosavi, Q. Esmaili, A. Djerdir, and Y. A. Amirat, “Inter-Turn Fault Detection in Stator Winding of PMSM Using Wavelet Transform,” in 2017 IEEE Vehicle Power and Propulsion Conference (VPPC), IEEE, Dec. 2017, pp. 1–5. doi: 10.1109/VPPC.2017.8330891.
  8. Y. Zhang, G. Liu, W. Zhao, H. Zhou, Q. Chen, and M. Wei, “Online Diagnosis of Slight Interturn Short-Circuit Fault for a Low-Speed Permanent Magnet Synchronous Motor,” IEEE Trans. Transp. Electrif., vol. 7, no. 1, pp. 104–113, Mar. 2021, doi: 10.1109/TTE.2020.2991271.
  9. V. Nguyen et al., “A Method for Incipient Interturn Fault Detection and Severity Estimation of Induction Motors under Inherent Asymmetry and Voltage Imbalance,” IEEE Trans. Transp. Electrif., vol. 3, no. 3, pp. 703–715, Sep. 2017, doi: 10.1109/TTE.2017.2726351.
  10. Y. D. Nyanteh, S. K. Srivastava, C. S. Edrington, and D. A. Cartes, “Application of artificial intelligence to stator winding fault diagnosis in Permanent Magnet Synchronous Machines,” Electr. Power Syst. Res., vol. 103, pp. 201–213, 2013, doi: 10.1016/j.epsr.2013.05.018.
  11. Y.-W. Youn, D.-H. Hwang, S.-J. Song, and Y.-H. Kim, “Detection and Classification of Demagnetization and Short-Circuited Turns in Permanent Magnet Synchronous Motors,” J Electr Eng Technol, vol. 13, no. 4, pp. 1614–1622, 2018, doi: 10.5370/JEET.2018.13.4.1614.
  12. S. Liang, Y. Chen, H. Liang, and X. Li, “Sparse representation and SVM diagnosis method inter-turn short-circuit fault in PMSM,” Appl. Sci., vol. 9, no. 2, Jan. 2019, doi: 10.3390/app9020224.
  13. C. S. Wang, I. H. Kao, and J. W. Perng, “Fault diagnosis and fault frequency determination of permanent magnet synchronous motor based on deep learning,” Sensors, vol. 21, no. 11, Jun. 2021, doi: 10.3390/s21113608.
  14. I. H. Kao, W. J. Wang, Y. H. Lai, and J. W. Perng, “Analysis of Permanent Magnet Synchronous Motor Fault Diagnosis Based on Learning,” IEEE Trans. Instrum. Meas., vol. 68, no. 2, pp. 310–324, Feb. 2019, doi: 10.1109/TIM.2018.2847800.
  15. Z. Zhang, D. Zhang, and R. C. Qiu, “Deep reinforcement learning for power system applications: An overview,” CSEE Journal of Power and Energy Systems, vol. 6, no. 1. Institute of Electrical and Electronics Engineers Inc., pp. 213–225, Mar. 01, 2020. doi: 10.17775/CSEEJPES.2019.00920.
  16. J. Feng, M. Huang, L. Zhao, Y. Yang, and X. Zhu, “Reinforcement Learning for Relation Classification from Noisy Data.” [Online]. Available:
  17. Università degli studi Roma tre, European Association for Signal Processing, IEEE Signal Processing Society, and Institute of Electrical and Electronics Engineers, EUSIPCO 2018 : 26th European Signal Processing Conference : Rome, Italy, September 3 - 7, 2018.
  18. D. Silver et al., “Mastering the game of Go with deep neural networks and tree search,” Nature, vol. 529, no. 7587, pp. 484–489, 2016, doi: 10.1038/nature16961.
  19. V. Mnih et al., “Playing Atari with Deep Reinforcement Learning,” Dec. 2013, [Online]. Available:
  20. IEEE Robotics and Automation Society and Institute of Electrical and Electronics Engineers, ICRA2017 : IEEE International Conference on Robotics and Automation : program : May 29-June 3, 2017, Singapore.
  21. Y. Ding et al., “Intelligent fault diagnosis for rotating machinery using deep Q-network based health state classification: A deep reinforcement learning approach,” Adv. Eng. Informatics, vol. 42, no. January, p. 100977, 2019, doi: 10.1016/j.aei.2019.100977.
  22. K. Arulkumaran, M. P. Deisenroth, M. Brundage, and A. A. Bharath, “Deep reinforcement learning: A brief survey,” IEEE Signal Processing Magazine, vol. 34, no. 6. Institute of Electrical and Electronics Engineers Inc., pp. 26–38, Nov. 01, 2017. doi: 10.1109/MSP.2017.2743240.
  23. I. Kandel and M. Castelli, “Transfer learning with convolutional neural networks for diabetic retinopathy image classification. A review,” Applied Sciences (Switzerland), vol. 10, no. 6. MDPI AG, Mar. 01, 2020. doi: 10.3390/app10062021.
  24. B. S. Mahmood and S. A. Dawwd, “Development and Evaluation of two Memory Architectures for the Hardware Version of CNN Face Recognizer,” Al-Rafidain Eng. J., vol. 27, no. 2, pp. 190–197, 2022.
  25. S. Albawi, T. A. Mohammed, and S. Al-Zawi, “Understanding of a convolutional neural network,” in 2017 International Conference on Engineering and Technology (ICET), IEEE, Aug. 2017, pp. 1–6. doi: 10.1109/ICEngTechnol.2017.8308186.
  26. H. Gu, Y. Wang, S. Hong, and G. Gui, “Blind channel identification aided generalized automatic modulation recognition based on deep learning,” IEEE Access, vol. 7, pp. 110722–110729, 2019, doi: 10.1109/ACCESS.2019.2934354.
  27. V. Mnih et al., “Human-level control through deep reinforcement learning,” Nature, vol. 518, no. 7540, pp. 529–533, Feb. 2015, doi: 10.1038/nature14236.
  28. S. Levine, C. Finn, T. Darrell, and P. Abbeel, “End-to-end training of deep visuomotor policies,” J. Mach. Learn. Res., vol. 17, pp. 1–40, 2016.
  29. F. Pusse and M. Klusch, “Hybrid online POMDP planning and deep reinforcement learning for safer self-driving cars,” IEEE Intell. Veh. Symp. Proc., vol. 2019-June, no. Iv, pp. 1013–1020, 2019, doi: 10.1109/IVS.2019.8814125.
  30. H. M. Chung, S. Maharjan, Y. Zhang, and F. Eliassen, “Distributed Deep Reinforcement Learning for Intelligent Load Scheduling in Residential Smart Grids,” IEEE Trans. Ind. Informatics, vol. 17, no. 4, pp. 2752–2763, 2021, doi: 10.1109/TII.2020.3007167.
  31. K. Lei, B. Zhang, Y. Li, M. Yang, and Y. Shen, “Time-driven feature-aware jointly deep reinforcement learning for financial signal representation and algorithmic trading,” Expert Syst. Appl., vol. 140, pp. 1–14, 2020, doi: 10.1016/j.eswa.2019.112872.
  32. R. Zhang and Y. Gu, “A Transfer Learning Framework with a One-Dimensional Deep Subdomain Adaptation Network for Bearing Fault Diagnosis under Different Working Conditions,” Sensors, vol. 22, no. 4, 2022, doi: 10.3390/s22041624.
  33. W. Jung, S. H. Yun, Y. S. Lim, S. Cheong, and Y. H. Park, “Vibration and current dataset of three-phase permanent magnet synchronous motors with stator faults,” Data Br., vol. 47, p. 108952, 2023, doi: 10.1016/j.dib.2023.108952