Active fault-tolerant coordination energy management for a proton exchange membrane fuel cell using curriculum-based multiagent deep meta-reinforcement learning

Jiawen Li and Tao Zhou

Renewable and Sustainable Energy Reviews, 2023, vol. 185, issue C

Abstract: This paper addresses the challenge of active fault-tolerant coordination control (AFTCC) for proton exchange membrane fuel cells (PEMFCs), which are complex nonlinear systems with multiple inputs and outputs. Conventional fault-tolerant control methods cannot properly coordinate multiple operating variables and prevent constraint violations in PEMFCs. Our proposed AFTCC method seeks to stabilize the output performance of four operating variables and avoid PEMFC operating constraint violations during failure scenarios. Our method is supported by a curriculum-based multiagent deep meta-deterministic policy gradient (CMA-DMDPG) algorithm, which integrates meta-reinforcement learning, multiagent reinforcement learning and curriculum learning to achieve multitask collaboration of multiple agents, thereby enhancing PEMFC robustness. The algorithm consists of a meta-learner and a base learner. The base learner regards the hydrogen controller, oxygen controller, pump controller and radiator controller as four independent agents and thus achieves a cooperative control policy. The meta-learner detects PEMFC faults and selects an appropriate cooperative control policy. The performance of AFTCC under various stochastic and fault conditions is evaluated using a 75 kW PEMFC model. The results showed that the performance of AFTCC surpassed 11 other fault-tolerant control methods in terms of output voltage, oxygen excess ratio, and stack temperature, and avoided constraint violations.

Keywords: Active fault tolerant control; meta-Reinforcement learning; Proton exchange membrane fuel cell; Operating variables; Meta-learner (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S1364032123004380
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:rensus:v:185:y:2023:i:c:s1364032123004380

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/bibliographic
http://www.elsevier. ... 600126/bibliographic

DOI: 10.1016/j.rser.2023.113581

Access Statistics for this article

Renewable and Sustainable Energy Reviews is currently edited by L. Kazmerski

More articles in Renewable and Sustainable Energy Reviews from Elsevier
Bibliographic data for series maintained by Catherine Liu ().