PuSH - Publication Server of Helmholtz Zentrum München

Klede, K.* ; Altstidl, T.* ; Zanca, D.* ; Eskofier, B.M.

The impact of random models on standardized clustering similarity.

IEEE Access, DOI: 10.1109/ACCESS.2024.3507133 (2024)
Publ. Version/Full Text DOI
Open Access Gold
Creative Commons Lizenzvertrag
Clustering similarity measures are essential for evaluating clustering results and ensuring diversity in multiple clusterings of the same dataset. Common indices like the Mutual Information (MI) and Rand Index (RI) are biased towards smaller clusters and are often adjusted using a random permutation model. Recent advancements have standardized these measures to further correct biases, but the impact of different random models on these standardized measures has not yet been studied. In this work, we introduce equations for standardizing the MI/RI under non-permutation models, specifically focusing on a uniform model over all clusterings and a model that fixes the number of clusterings. Our results show that while standardization improves performance for the fixed number of clusters model, its benefits are limited in the more general uniform model. We validate our findings with gene expression data, highlighting the importance of choosing the right similarity metric for clustering comparison.
Altmetric
Additional Metrics?
Edit extra informations Login
Publication type Article: Journal article
Document type Scientific Article
Corresponding Author
Keywords Clustering Comparison ; External Evaluation Metrics ; Machine Learning ; Mutual Information ; Rand Index ; Random Model
ISSN (print) / ISBN 2169-3536
e-ISSN 2169-3536
Journal IEEE Access
Publisher IEEE
Non-patent literature Publications
Reviewing status Peer reviewed
Institute(s) Institute of AI for Health (AIH)