Schmitz, S.* ; Brucke, K.* ; Kasturi, P.* ; Ansari, E.* ; Klement, P.*
Forecast-based and data-driven reinforcement learning for residential heat pump operation.
Appl. Energy 371, 10 (2024)
Electrified residential heating systems have great potential for flexibility provision to the electricity grid with advanced operation control mechanisms being able to harness that. In this work, we therefore apply a reinforcement learning (RL) approach for the operation of a residential heat pump in a simulation study and compare the results with a classical rule-based approach. Doing so, we consider an apartment complex with 100 living units and a central heat pump along with a central hot water tank serving as heat storage. Unlike other studies in the field, we focus on a data driven approach where no building model is required and living comfort of the residents is never compromised. Both factors maximize the applicability in real world buildings. Additionally, we examine the effects of uncertainty on the heat pump operation. This is carried out by testing four different observation spaces each with different data visibility and availability to the RL agent. With that we also simulate the heat pump operation under forecast conditions which has not been done before to the best of our knowledge. We find that the inertia of typical residential heat systems is high enough so that missing or uncertain information has only a minor effect on the operation. Compared to the rule-based approach all RL agents are able to exploit variable electricity prices and the flexibility of the heat storage in such a way, that electricity costs and energy consumption can be significantly reduced. Additionally, a large proportion of the nominal electrical power of the installed heat pump could be saved with the presented intelligent operation. The robustness of the approach is shown by running ten independent training and testing cycles for all setups with reproducible results.
Impact Factor
Scopus SNIP
Web of Science
Times Cited
Scopus
Cited By
Altmetric
Publikationstyp
Artikel: Journalartikel
Dokumenttyp
Wissenschaftlicher Artikel
Typ der Hochschulschrift
Herausgeber
Schlagwörter
Demand Forecast ; Heat Pump Operation ; Operation Under Uncertainty ; Reinforcement Learning ; Residential Heating
Keywords plus
Sprache
englisch
Veröffentlichungsjahr
2024
Prepublished im Jahr
0
HGF-Berichtsjahr
2024
ISSN (print) / ISBN
0306-2619
e-ISSN
ISBN
Bandtitel
Konferenztitel
Konferzenzdatum
Konferenzort
Konferenzband
Quellenangaben
Band: 371,
Heft: ,
Seiten: 10
Artikelnummer: ,
Supplement: ,
Reihe
Verlag
Elsevier
Verlagsort
Amsterdam [u.a.]
Tag d. mündl. Prüfung
0000-00-00
Betreuer
Gutachter
Prüfer
Topic
Hochschule
Hochschulort
Fakultät
Veröffentlichungsdatum
0000-00-00
Anmeldedatum
0000-00-00
Anmelder/Inhaber
weitere Inhaber
Anmeldeland
Priorität
Begutachtungsstatus
Peer reviewed
Institut(e)
Helmholtz AI - DLR (HAI - DLR)
POF Topic(s)
Forschungsfeld(er)
PSP-Element(e)
Förderungen
Federal Ministry of Education and Research (BMBF) in the project ENaQ
German Federal Ministry for Economic Affairs and Climate Action (BMWK)
Local Unit 'Munich Unit @Aeronautics, Space and Transport (MASTr) '
Helmholtz Association's Initiative and Networking Fund (INF) under Helmholtz AI platform grant agreement
Copyright
Erfassungsdatum
2024-07-01