PuSH - Publikationsserver des Helmholtz Zentrums München

Schmitz, S.* ; Brucke, K.* ; Kasturi, P.* ; Ansari, E.* ; Klement, P.*

Forecast-based and data-driven reinforcement learning for residential heat pump operation.

Appl. Energy 371, 10 (2024)
Verlagsversion DOI
Open Access Hybrid
Electrified residential heating systems have great potential for flexibility provision to the electricity grid with advanced operation control mechanisms being able to harness that. In this work, we therefore apply a reinforcement learning (RL) approach for the operation of a residential heat pump in a simulation study and compare the results with a classical rule-based approach. Doing so, we consider an apartment complex with 100 living units and a central heat pump along with a central hot water tank serving as heat storage. Unlike other studies in the field, we focus on a data driven approach where no building model is required and living comfort of the residents is never compromised. Both factors maximize the applicability in real world buildings. Additionally, we examine the effects of uncertainty on the heat pump operation. This is carried out by testing four different observation spaces each with different data visibility and availability to the RL agent. With that we also simulate the heat pump operation under forecast conditions which has not been done before to the best of our knowledge. We find that the inertia of typical residential heat systems is high enough so that missing or uncertain information has only a minor effect on the operation. Compared to the rule-based approach all RL agents are able to exploit variable electricity prices and the flexibility of the heat storage in such a way, that electricity costs and energy consumption can be significantly reduced. Additionally, a large proportion of the nominal electrical power of the installed heat pump could be saved with the presented intelligent operation. The robustness of the approach is shown by running ten independent training and testing cycles for all setups with reproducible results.
Impact Factor
Scopus SNIP
Altmetric
10.100
2.411
Tags
Anmerkungen
Besondere Publikation
Auf Hompepage verbergern

Zusatzinfos bearbeiten
Eigene Tags bearbeiten
Privat
Eigene Anmerkung bearbeiten
Privat
Auf Publikationslisten für
Homepage nicht anzeigen
Als besondere Publikation
markieren
Publikationstyp Artikel: Journalartikel
Dokumenttyp Wissenschaftlicher Artikel
Schlagwörter Demand Forecast ; Heat Pump Operation ; Operation Under Uncertainty ; Reinforcement Learning ; Residential Heating
Sprache englisch
Veröffentlichungsjahr 2024
HGF-Berichtsjahr 2024
ISSN (print) / ISBN 0306-2619
Zeitschrift Applied Energy
Quellenangaben Band: 371, Heft: , Seiten: 10 Artikelnummer: , Supplement: ,
Verlag Elsevier
Verlagsort Amsterdam [u.a.]
Begutachtungsstatus Peer reviewed
Institut(e) Helmholtz AI - DLR (HAI - DLR)
Förderungen Federal Ministry of Education and Research (BMBF) in the project ENaQ
German Federal Ministry for Economic Affairs and Climate Action (BMWK)
Local Unit 'Munich Unit @Aeronautics, Space and Transport (MASTr) '
Helmholtz Association's Initiative and Networking Fund (INF) under Helmholtz AI platform grant agreement
Scopus ID 85196281945
Erfassungsdatum 2024-07-01