PuSH - Publikationsserver des Helmholtz Zentrums München

Gruaz, L.* ; Modirshanechi, A. ; Becker, S.* ; Brea, J.*

Merits of curiosity: A simulation study.

Open Mind 9, 1037-1065 (2025)
Verlagsversion Forschungsdaten DOI
Open Access Gold
Creative Commons Lizenzvertrag
‘Why are we curious?’ has been among the central puzzles of neuroscience and psychology in the past decades. A popular hypothesis is that curiosity is driven by intrinsically generated reward signals, which have evolved to support survival in complex environments. To formalize and test this hypothesis, we need to understand the enigmatic relationship between (i) intrinsic rewards (as drives of curiosity), (ii) optimality conditions (as objectives of curiosity), and (iii) environment structures. Here, we demystify this relationship through a systematic simulation study. First, we propose an algorithm to generate environments that capture key abstract features of different real-world situations. Then, we simulate artificial agents that explore these environments by seeking one of six representative intrinsic rewards: novelty, surprise, information gain, empowerment, maximum occupancy principle, and successor-predecessor intrinsic exploration. We evaluate the exploration performance of these simulated agents regarding three potential objectives of curiosity: state discovery, model accuracy, and uniform state visitation. Our results show that the comparative performance of each intrinsic reward is highly dependent on the environmental features and the curiosity objective; this indicates that ‘optimality’ in top-down theories of curiosity needs a precise formulation of assumptions. Nevertheless, we found that agents seeking a combination of novelty and information gain always achieve a close-to-optimal performance on objectives of curiosity as well as in collecting extrinsic rewards. This suggests that novelty and information gain are two principal axes of curiosity-driven behavior. These results pave the way for the further development of computational models of curiosity and the design of theory-informed experimental paradigms.
Impact Factor
Scopus SNIP
Altmetric
0.000
0.975
Tags
Anmerkungen
Besondere Publikation
Auf Hompepage verbergern

Zusatzinfos bearbeiten
Eigene Tags bearbeiten
Privat
Eigene Anmerkung bearbeiten
Privat
Auf Publikationslisten für
Homepage nicht anzeigen
Als besondere Publikation
markieren
Publikationstyp Artikel: Journalartikel
Dokumenttyp Wissenschaftlicher Artikel
Schlagwörter Algorithm ; Computational ; Curiosity ; Empowerment ; Environment ; Exploration ; Generation ; Information Gain ; Mop ; Neuroscience ; Novelty ; Reinforcement Learning ; Rl ; Spie ; Structure ; Surprise
Sprache englisch
Veröffentlichungsjahr 2025
HGF-Berichtsjahr 2025
ISSN (print) / ISBN 2470-2986
e-ISSN 2470-2986
Zeitschrift Open Mind
Quellenangaben Band: 9, Heft: , Seiten: 1037-1065 Artikelnummer: , Supplement: ,
Verlag MIT Press
Begutachtungsstatus Peer reviewed
POF Topic(s) 30205 - Bioengineering and Digital Health
Forschungsfeld(er) Enabling and Novel Technologies
PSP-Element(e) G-540011-001
Scopus ID 105015671206
Erfassungsdatum 2025-10-22