PuSH - Publication Server of Helmholtz Zentrum München

Samaga, D. ; Hornung, R.* ; Braselmann, H. ; Hess J. ; Zitzelsberger, H. ; Belka, C. ; Boulesteix, A.L.* ; Unger, K.

Single-center versus multi-center data sets for molecular prognostic modeling: A simulation study.

Radiat. Oncol. 15:109 (2020)
Publ. Version/Full Text Research data DOI PMC
Open Access Gold
Creative Commons Lizenzvertrag
Background Prognostic models based on high-dimensional omics data generated from clinical patient samples, such as tumor tissues or biopsies, are increasingly used for prognosis of radio-therapeutic success. The model development process requires two independent discovery and validation data sets. Each of them may contain samples collected in a single center or a collection of samples from multiple centers. Multi-center data tend to be more heterogeneous than single-center data but are less affected by potential site-specific biases. Optimal use of limited data resources for discovery and validation with respect to the expected success of a study requires dispassionate, objective decision-making. In this work, we addressed the impact of the choice of single-center and multi-center data as discovery and validation data sets, and assessed how this impact depends on the three data characteristics signal strength, number of informative features and sample size. Methods We set up a simulation study to quantify the predictive performance of a model trained and validated on different combinations of in silico single-center and multi-center data. The standard bioinformatical analysis workflow of batch correction, feature selection and parameter estimation was emulated. For the determination of model quality, four measures were used: false discovery rate, prediction error, chance of successful validation (significant correlation of predicted and true validation data outcome) and model calibration. Results In agreement with literature about generalizability of signatures, prognostic models fitted to multi-center data consistently outperformed their single-center counterparts when the prediction error was the quality criterion of interest. However, for low signal strengths and small sample sizes, single-center discovery sets showed superior performance with respect to false discovery rate and chance of successful validation. Conclusions With regard to decision making, this simulation study underlines the importance of study aims being defined precisely a priori. Minimization of the prediction error requires multi-center discovery data, whereas single-center data are preferable with respect to false discovery rate and chance of successful validation when the expected signal or sample size is low. In contrast, the choice of validation data solely affects the quality of the estimator of the prediction error, which was more precise on multi-center validation data.
Altmetric
Additional Metrics?
[➜Log in]
Edit extra informations Login
Publication type Article: Journal article
Document type Scientific Article
Corresponding Author
Keywords Predictive Model ; Omics Data ; Feature Selection ; Predictive Performance ; Study Design ; Validation; Gene-expression; Treatment Decisions; Signature; Validation; Prediction; Head
ISSN (print) / ISBN 1748-717X
e-ISSN 1748-717X
Journal Radiation Oncology
Quellenangaben Volume: 15, Issue: 1, Pages: , Article Number: 109 Supplement: ,
Publisher BioMed Central
Publishing Place Campus, 4 Crinan St, London N1 9xw, England
Non-patent literature Publications
Reviewing status Peer reviewed
Institute(s) Translational Metabolic Oncology (TMO)
CCG Personalized Radiotherapy in Head and Neck Cancer (KKG-KRT)