as soon as is submitted to ZB.
p-value Adjustment for Monotonous, Unbiased, and Fast Clustering Comparison.
In: (37th Conference on Neural Information Processing Systems (NeurIPS), 10-16 December 2023, New Orleans, LA). 10010 North Torrey Pines Rd, La Jolla, California 92037 Usa: Neural Information Processing Systems (nips), 2023. 16
Popular metrics for clustering comparison, like the Adjusted Rand Index and the Adjusted Mutual Information, are type II biased. The Standardized Mutual Information removes this bias but suffers from counterintuitive non-monotonicity and poor computational efficiency. We introduce the p-value adjusted Rand Index (PMI2), the first cluster comparison method that is type II unbiased and provably monotonous. The PMI2 has fast approximations that outperform the Standardized Mutual information. We demonstrate its unbiased clustering selection, approximation quality, and runtime efficiency on synthetic benchmarks. In experiments on image and social network datasets, we show how the PMI2 can help practitioners choose better clustering and community detection algorithms.
Annotations
Special Publikation
Hide on homepage
Publication type
Article: Conference contribution
Language
english
Publication Year
2023
HGF-reported in Year
2023
ISSN (print) / ISBN
1049-5258
Conference Title
37th Conference on Neural Information Processing Systems (NeurIPS)
Conference Date
10-16 December 2023
Conference Location
New Orleans, LA
Quellenangaben
Pages: 16
Publisher
Neural Information Processing Systems (nips)
Publishing Place
10010 North Torrey Pines Rd, La Jolla, California 92037 Usa
Institute(s)
Institute of AI for Health (AIH)
POF-Topic(s)
30205 - Bioengineering and Digital Health
Research field(s)
Enabling and Novel Technologies
PSP Element(s)
G-540008-001
Grants
Bayern Innovativ - Bayerische Gesellschaft fur Innovation und Wissenstransfer mbH
Bayerischen Verbundforderprogramm (BayVFP) - Forderlinie Digitalisierung -Forderbereich Informations-und Kommunikationstechnik of the Bavarian Ministry of Economic Affairs, Regional Development and Energy
Bayerischen Verbundforderprogramm (BayVFP) - Forderlinie Digitalisierung -Forderbereich Informations-und Kommunikationstechnik of the Bavarian Ministry of Economic Affairs, Regional Development and Energy
WOS ID
001229751903044
Erfassungsdatum
2024-07-30