PuSH - Publication Server of Helmholtz Zentrum München

Klede, K.* ; Altstidl, T.* ; Zanca, D.* ; Eskofier, B.M.

p-value adjustment for monotonous, unbiased, and fast clustering comparison.

In: (Advances in Neural Information Processing Systems). 2023. (Advances in Neural Information Processing Systems ; 36)
Publ. Version/Full Text
Popular metrics for clustering comparison, like the Adjusted Rand Index and the Adjusted Mutual Information, are type II biased. The Standardized Mutual Information removes this bias but suffers from counterintuitive non-monotonicity and poor computational efficiency. We introduce the p-value adjusted Rand Index (PMI2), the first cluster comparison method that is type II unbiased and provably monotonous. The PMI2 has fast approximations that outperform the Standardized Mutual information. We demonstrate its unbiased clustering selection, approximation quality, and runtime efficiency on synthetic benchmarks. In experiments on image and social network datasets, we show how the PMI2 can help practitioners choose better clustering and community detection algorithms.
Additional Metrics?
Edit extra informations Login
Publication type Article: Conference contribution
Corresponding Author
ISSN (print) / ISBN 1049-5258
Conference Title Advances in Neural Information Processing Systems
Quellenangaben Volume: 36 Issue: , Pages: , Article Number: , Supplement: ,
Non-patent literature Publications
Institute(s) Institute of AI for Health (AIH)