PuSH - Publication Server of Helmholtz Zentrum München

Export: TXT Text RIS Endnote (RIS) BIB BibTeX
von Kleist, H. ; Zamanian, A.* ; Shpitser, I.* ; Ahmidi, N.

Evaluation of active feature acquisition methods for time-varying feature settings.

J. Mach. Learn. Res. 26:84 (2025)
Publ. Version/Full Text
Closed
Creative Commons Lizenzvertrag
Machine learning methods often assume that input features are available at no cost. However, in domains like healthcare, where acquiring features could be expensive or harmful, it is necessary to balance a feature's acquisition cost against its predictive value. The task of training an AI agent to decide which features to acquire is called active feature acquisition (AFA). By deploying an AFA agent, we effectively alter the acquisition strategy and trigger a distribution shift. To safely deploy AFA agents under this distribution shift, we present the problem of active feature acquisition performance evaluation (AFAPE). We examine AFAPE under i) a no direct effect (NDE) assumption, stating that acquisitions do not affect the underlying feature values; and ii) a no unobserved confounding (NUC) assumption, stating that retrospective feature acquisition decisions were only based on observed features. We show that one can apply missing data methods under the NDE assumption and offline reinforcement learning under the NUC assumption. When NUC and NDE hold, we propose a novel semi-offline reinforcement learning framework. This framework requires a weaker positivity assumption and introduces three new estimators: A direct method (DM), an inverse probability weighting (IPW), and a double reinforcement learning (DRL) estimator.
Impact Factor
Scopus SNIP
5.200
0.000
Tags
Annotations
Special Publikation
Hide on homepage

Edit extra information
Edit own tags
Private
Edit own annotation
Private
Hide on publication lists
on hompage
Mark as special
publikation
Publication type Article: Journal article
Document type Scientific Article
Keywords active feature acquisition; semi-offline reinforcement learning; dynamic test-ing regimes; missing data; causal inference; semiparametric theory; Information Evaluation; Cash Equivalents; Cancer; Uncertainty; Decisions; Models; Risk
Language english
Publication Year 2025
HGF-reported in Year 2025
ISSN (print) / ISBN 1532-4435
e-ISSN 1533-7928
Journal Journal of Machine Learning Research
Quellenangaben Volume: 26, Issue: , Pages: , Article Number: 84 Supplement: ,
Publisher MIT Press
Publishing Place 31 Gibbs St, Brookline, Ma 02446 Usa
Reviewing status Peer reviewed
Institute(s) Institute of Computational Biology (ICB)
POF-Topic(s) 30205 - Bioengineering and Digital Health
Research field(s) Enabling and Novel Technologies
PSP Element(s) G-503800-007
Grants Bayer Foundation
Helmholtz Association
WOS ID 001470564500001
Scopus ID 105018579205
Erfassungsdatum 2025-05-13
[➜Report correction]