Energy Management Strategy Combining Double Deep Q-Networks and Demand Torque Prediction for Connected Hybrid Electric Vehicles
IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING(2024)
摘要
This paper proposes an energy management strategy (EMS) based on double-deep Q-Networks (DDQN) with demand torque prediction (DTP) to optimize the fuel consumption of hybrid electric vehicles (HEVs) by online utilizing vehicle-to-vehicle (V2V) information. The main framework of the EMS is designed as DDQN, combining Q-learning with the deep neural network to realize real-time training and online optimization of the torque distribution between the internal combustion engine and the electric motor, and given that the model training easily falls into local minima and overestimation, two different Q-networks are designed to decouple action selection and target evaluation. Meanwhile, BP-network predicts future demand torque using the ego vehicle speed, front vehicle speed, and distance between the two vehicles to reduce the burden of model training due to the introduction of traffic information. The predicted demand torque is introduced into the DDQN-based EMS as states, together with the distance traveled in the driving cycle and the current information on HEV. The effectiveness and adaptability to actual driving cycles of the proposed strategy are verified by comparison with DDQN-based EMS without DTP and rule-based EMS. The results show that the fuel consumption using DDQN-based EMS without DTP is reduced by 4.1% compared with rule-based EMS. The introduction of demand torque prediction resulted in a further 3.9% reduction in fuel consumption.
更多查看译文
关键词
hybrid electric vehicles (HEVs),energy management strategy (EMS),double-deep Q-Networks (DDQN),demand torque prediction (DTP),vehicle-to-vehicle (V2V) information
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要