An Online Learning Control Strategy for Hybrid Electric Vehicle Based on Fuzzy Q-Learning

Yue Hu, Weimin Li, Hui Xu and Guoqing Xu
Additional contact information
Yue Hu: Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
Weimin Li: Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
Hui Xu: Jining Institutes of Advanced Technology, Chinese Academy of Sciences, Jining 272000, China
Guoqing Xu: Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China

Energies, 2015, vol. 8, issue 10, 1-20

Abstract: In order to realize the online learning of a hybrid electric vehicle (HEV) control strategy, a fuzzy Q-learning (FQL) method is proposed in this paper. FQL control strategies consists of two parts: The optimal action-value function Q *( x , u ) estimator network (QEN) and the fuzzy parameters tuning (FPT). A back propagation (BP) neural network is applied to estimate Q *( x , u ) as QEN. For the fuzzy controller, we choose a Sugeno-type fuzzy inference system (FIS) and the parameters of the FIS are tuned online based on Q *( x , u ). The action exploration modifier (AEM) is introduced to guarantee all actions are tried. The main advantage of a FQL control strategy is that it does not rely on prior information related to future driving conditions and can self-tune the parameters of the fuzzy controller online. The FQL control strategy has been applied to a HEV and simulation tests have been done. Simulation results indicate that the parameters of the fuzzy controller are tuned online and that a FQL control strategy achieves good performance in fuel economy.

Keywords: hybrid electric vehicle; fuzzy Q-learning (FQL) control strategy; Q *( x , u ) estimator network (QEN); fuzzy parameters tuning (FPT) (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2015
References: View complete reference list from CitEc
Citations: View citations in EconPapers (10)

Downloads: (external link)
https://www.mdpi.com/1996-1073/8/10/11167/pdf (application/pdf)
https://www.mdpi.com/1996-1073/8/10/11167/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:8:y:2015:i:10:p:11167-11186:d:56841

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().