Understanding information theoretic measures for comparing clusterings

van der Hoef, H. & Warrens, M. J., Oct-2019, In : Behaviormetrika. 45, 2, p. 353–370 18 p., 75.

Research output: Contribution to journalArticleAcademicpeer-review

Many external validity indices for comparing different clusterings of the same set of objects are overall measures: they quantify similarity between clusterings for all clusters simultaneously. Because a single number only provides a general notion of what is going on, the values of such overall indices (usually between 0 and 1) are often difficult to interpret. In this paper, we show that a class of normalizations of the mutual information can be decomposed into indices that contain information on the level of individual clusters. The decompositions (1) reveal that overall measures can be interpreted as summary statistics of information reflected in the individual clusters, (2) specify how these overall indices are related to individual clusters, and (3) show that the overall indices are affected by cluster size imbalance. We recom-mend to use measures for individual clusters since they provide much more detailed information than a single overall number
Original languageEnglish
Article number75
Pages (from-to)353–370
Number of pages18
Issue number2
Early online date4-Dec-2018
Publication statusPublished - Oct-2019

Download statistics

No data available

ID: 71852143