Zamanian, A.* ; von Kleist, H. ; Ciora, O.A.* ; Piperno, M.* ; Lancho, G.* ; Ahmidi, N.*
Analysis of missingness scenarios for observational health data.
J. Pers. Med. 14:32 (2024)
Despite the extensive literature on missing data theory and cautionary articles emphasizing the importance of realistic analysis for healthcare data, a critical gap persists in incorporating domain knowledge into the missing data methods. In this paper, we argue that the remedy is to identify the key scenarios that lead to data missingness and investigate their theoretical implications. Based on this proposal, we first introduce an analysis framework where we investigate how different observation agents, such as physicians, influence the data availability and then scrutinize each scenario with respect to the steps in the missing data analysis. We apply this framework to the case study of observational data in healthcare facilities. We identify ten fundamental missingness scenarios and show how they influence the identification step for missing data graphical models, inverse probability weighting estimation, and exponential tilting sensitivity analysis. To emphasize how domain-informed analysis can improve method reliability, we conduct simulation studies under the influence of various missingness scenarios. We compare the results of three common methods in medical data analysis: complete-case analysis, Missforest imputation, and inverse probability weighting estimation. The experiments are conducted for two objectives: variable mean estimation and classification accuracy. We advocate for our analysis approach as a reference for the observational health data analysis. Beyond that, we also posit that the proposed analysis framework is applicable to other medical domains.
Impact Factor
Scopus SNIP
Web of Science
Times Cited
Scopus
Cited By
Altmetric
Publication type
Article: Journal article
Document type
Scientific Article
Thesis type
Editors
Keywords
Missing Data Analysis ; Missing Data Assumptions ; Missingness Distribution Shift ; Missingness Scenarios ; Observational Health Data; Multiple Imputation; Risk; Prediction; Monotone; Model; Score
Keywords plus
Language
english
Publication Year
2024
Prepublished in Year
0
HGF-reported in Year
2024
ISSN (print) / ISBN
2075-4426
e-ISSN
2075-4426
ISBN
Book Volume Title
Conference Title
Conference Date
Conference Location
Proceedings Title
Quellenangaben
Volume: 14,
Issue: 5,
Pages: ,
Article Number: 32
Supplement: ,
Series
Publisher
MDPI
Publishing Place
Basel, Switzerland
Day of Oral Examination
0000-00-00
Advisor
Referee
Examiner
Topic
University
University place
Faculty
Publication date
0000-00-00
Application date
0000-00-00
Patent owner
Further owners
Application country
Patent priority
Reviewing status
Peer reviewed
POF-Topic(s)
30205 - Bioengineering and Digital Health
Research field(s)
Enabling and Novel Technologies
PSP Element(s)
G-503800-007
Grants
Bayerisches Staatsministerium für Wirtschaft, Landesentwicklung und Energie
Copyright
Erfassungsdatum
2024-07-16