On Consistent Entropy-Regularized k-Means Clustering With Feature Weight Learning: Algorithm and Statistical Analyses
Article Type
Research Article
Publication Title
IEEE Transactions on Cybernetics
Abstract
Clusters in real data are often restricted to low-dimensional subspaces rather than the entire feature space. Recent approaches to circumvent this difficulty are often computationally inefficient and lack theoretical justification in terms of their large-sample behavior. This article deals with the problem by introducing an entropy incentive term to efficiently learn the feature importance within the framework of center-based clustering. A scalable block-coordinate descent algorithm, with closed-form updates, is incorporated to minimize the proposed objective function. We establish theoretical guarantees on our method by Vapnik-Chervonenkis (VC) theory to establish strong consistency along with uniform concentration bounds. The merits of our method are showcased through detailed experimental analysis on toy examples as well as real data clustering benchmarks.
First Page
4779
Last Page
4790
DOI
https://10.1109/TCYB.2022.3166975
Publication Date
8-1-2023
Recommended Citation
Chakraborty, Saptarshi; Paul, Debolina; and Das, Swagatam, "On Consistent Entropy-Regularized k-Means Clustering With Feature Weight Learning: Algorithm and Statistical Analyses" (2023). Journal Articles. 3638.
https://digitalcommons.isical.ac.in/journal-articles/3638