A Bimodality Test in High Dimensions

Authors

  • Dean Palejev

DOI:

https://doi.org/10.55630/sjc.2012.6.437-450

Keywords:

Clustering, Bimodality, Multidimensional Space, Asymptotic Test

Abstract

We present a test for identifying clusters in high dimensional data based on the k-means algorithm when the null hypothesis is spherical normal. We show that projection techniques used for evaluating validity of clusters may be misleading for such data. In particular, we demonstrate that increasingly well-separated clusters are identified as the dimensionality increases, when no such clusters exist. Furthermore, in a case of true bimodality, increasing the dimensionality makes identifying the correct clusters more difficult. In addition to the original conservative test, we propose a practical test with the same asymptotic behavior that performs well for a moderate number of points and moderate dimensionality. ACM Computing Classification System (1998): I.5.3.

Downloads

Published

2013-03-20

Issue

Section

Articles