Learning to Calibrate Battery Models in Real-Time with Deep Reinforcement Learning

Ajaykumar Unagar, Yuan Tian, Manuel Arias Chao and Olga Fink
Additional contact information
Ajaykumar Unagar: ETH Zürich, Rämistrasse 101, 8092 Zürich, Switzerland
Yuan Tian: ETH Zürich, Rämistrasse 101, 8092 Zürich, Switzerland
Manuel Arias Chao: ETH Zürich, Rämistrasse 101, 8092 Zürich, Switzerland
Olga Fink: ETH Zürich, Rämistrasse 101, 8092 Zürich, Switzerland

Energies, 2021, vol. 14, issue 5, 1-12

Abstract: Lithium-ion (Li-I) batteries have recently become pervasive and are used in many physical assets. For the effective management of the batteries, reliable predictions of the end-of-discharge (EOD) and end-of-life (EOL) are essential. Many detailed electrochemical models have been developed for the batteries. Their parameters are calibrated before they are taken into operation and are typically not re-calibrated during operation. However, the degradation of batteries increases the reality gap between the computational models and the physical systems and leads to inaccurate predictions of EOD/EOL. The current calibration approaches are either computationally expensive (model-based calibration) or require large amounts of ground truth data for degradation parameters (supervised data-driven calibration). This is often infeasible for many practical applications. In this paper, we introduce a reinforcement learning-based framework for reliably inferring calibration parameters of battery models in real time. Most importantly, the proposed methodology does not need any labeled data samples of observations and the ground truth parameters. The experimental results demonstrate that our framework is capable of inferring the model parameters in real time with better accuracy compared to approaches based on unscented Kalman filters. Furthermore, our results show better generalizability than supervised learning approaches even though our methodology does not rely on ground truth information during training.

Keywords: model calibration; reinforcement learning; intelligent maintenance; lithium-ion batteries (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
https://www.mdpi.com/1996-1073/14/5/1361/pdf (application/pdf)
https://www.mdpi.com/1996-1073/14/5/1361/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:14:y:2021:i:5:p:1361-:d:508993

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().