65th ISI World Statistics Congress 2025

65th ISI World Statistics Congress 2025

Exploring the relationship between the geometry of a fixed embedding of image data and its underlying cluster structure

Author

CY
Chen-Hsiang Yeang

Co-author

  • Y
    Yan-Bin Chen
  • K
    Khong-Loon Tiong

Conference

65th ISI World Statistics Congress 2025

Format: IPS Abstract - WSC 2025

Keywords: clustering, convolutional_neural_network, fixed_embedding

Session: IPS 830 - Recent Advances in Large-Scale Network Data Analysis and Their Applications

Wednesday 8 October 2 p.m. - 3:40 p.m. (Europe/Amsterdam)

Abstract

Standard self-supervised clustering algorithms transform input data via embedding models that are trained to fit the data and then cluster the embedded vectors. Despite its flexibility, a data driven embedding model may not be applicable when the raw data are unavailable due to privacy or security concerns, and it cannot be adapted to the increasingly common framework of transfer learning. We previously proposed a Merge & Expand (ME) framework for clustering images using a fixed embedding model. In this study, we have substantially modified our ME framework and conducted a series of experimental analysis to explore the relationship between the geometry of a fixed embedding space and the underlying cluster structure. We demonstrate that the clustering outcomes are robust against varying hyperparameter values. We assessed the heterogeneity of predicted labels in each region, revealing that it is a strong indicator of the quality of clustering outcomes. We further exploited the heterogeneity information to modify the ME framework, improving clustering accuracy by introducing a second embedding. Moreover, we provide intuitive explanations for sources of confusion in merged seed regions. Comparisons with numerous other clustering methods on five datasets indicate that our ME framework performs competitively despite employing a fixed embedding, a simple CNN architecture, and a common loss function. Thus, our ME framework enables users to better understand the relationship between the geometry of the
embedding space and the underlying cluster structure.