Problems in Fuzzy c-means and Its Possible Solutions

허경용; JINSEOK SEO; Lee， Im Geun

Journal of The Korea Society of Computer and Information

Abbr : JKSCI
2011, 16(1), pp.39-46
Publisher : The Korean Society Of Computer And Information
Research Area : Computer Science

허경용 ¹ , JINSEOK SEO ² , Lee， Im Geun ³

¹ 동의대학교
² 동의대학교
³ 동의대학교

ABSTRACT

Clustering is one of the well-known unsupervised learning methods, in which a data set is grouped into some number of homogeneous clusters. There are numerous clustering algorithms available and they have been used in various applications. Fuzzy c-means (FCM), the most well-known partitional clustering algorithm, was established in 1970's and still in use. However, there are some unsolved problems in FCM and variants of FCM are still under development. In this paper, the problems in FCM are first explained and the available solutions are investigated, which is aimed to give researchers some possible ways of future research. Most of the FCM variants try to solve the problems using domain knowledge specific to a given problem. However, in this paper, we try to give general solutions without using any domain knowledge. Although there are more things left than discovered, this paper may be a good starting point for researchers newly entered into a clustering area.
KEYWORDS

Fuzzy c-means , Unsupervised learning , Partitional clustering , Problems in FCM
REFERENCES (40)

[book] R. Xu / 2008 / Clustering / Wiley-IEEE Press

[book] J. B. MacQueen / 1967 / Some methods for classification and analysis of multivariate observations / University of California Press : 281~297

[journal] L. A. Zadeh / 1965 / Fuzzy sets / Information and Control 8 (3) : 338~353

[journal] E. H. Ruspini / 1969 / A new approach to clustering / Information and Control 16 : 22~32

[journal] J.C.Dunn / 1974 / A fuzzy relative of the ISODATA process and its use in detecting compact well separated clusters / Journal of Cybernetics : 32~57

[book] J. C. Bezdek / 1981 / Pattern Recognition with Fuzzy Objective Function Algorithms / Springer

[journal] H. Frigui / 1997 / Clustering by competitive agglomeration / Pattern Recognition 30 (7) : 1109~1119

[journal] 허경용 / 2008 / Extensions of X-means with Efficient Learning the Number of Clusters / 한국정보통신학회논문지 / 한국정보통신학회 12 (4) : 772~780

[confproc] G. Heo / 2009 / Learning the Number of Gaussian Components Using Hypothesis Test / Proceedings of the 2009 International Joint Conference on Neural Networks : 1206~1212

[journal] A. P. Dempster / 1977 / Maximum Likelihood from Incomplete Data via the EM Algorithm / Journal of the Royal Statistical Society 39 (1) : 1~38

[journal] Z. Zhang / 2003 / EM algorithms for Gaussian mixtures with split-and-merge operation / Pattern Recognition 36 (9) : 1973~1983

[confproc] Y. Li / 2009 / A Novel Split and Merge EM Algorithm for Gaussian Mixture Model / Proceedings of the 5th International Conference on Natural Computation : 479~483

[journal] R. N. Dave / 1991 / Characterization and detection of noise in clustering / Pattern Recognition Letters 12 (11) : 657~664

[confproc] Y. Namkoong / 2010 / An Extension of Possibilistic Fuzzy C-Means with Regularization / Proceedings of the 2010 IEEE International Conference on Fuzzy Systems : 696~701

[journal] A. Tikhonov / 1963 / On solving incorrectly posed problems and method of regularization / Dokl. Acad. Nauk USSR 151 : 501~504

[journal] 허경용 / 2009 / RKF-PCA: Robust kernel fuzzy PCA / NEURAL NETWORKS Volume: 22 Issue: 5-6 / PERGAMON-ELSEVIER SCIENCE LTD 22 (5-6) : 642~650

[journal] C. F. Lin / 2002 / Fuzzy support vector machines / IEEE Transactions on Neural Networks 13 (2) : 464~471

[book] P. J. Huber / 2009 / Robust Statistics, 2nd edition / Wiley

[journal] R. Krishnapuram / 1993 / A Possibilistic Approach to Clustering / IEEE Transactions on Fuzzy Systems 1 (2) : 98~110

[journal] N. R. Pal / 2005 / A Possibilistic Fuzzy c-Means Clustering Algorithm / IEEE Transactions on Fuzzy Systems 13 (4) : 517~530

[journal] 허경용 / 2009 / Improvement of the PFCM(Possibilistic Fuzzy C-Means) Clustering Method / 한국정보통신학회논문지 / 한국정보통신학회 13 (1) : 177~185

[journal] B. Feil / 2007 / Geodesic Distance Based Fuzzy Clustering / Advances in Soft Computing 39 : 50~59

[journal] F. Fouss / 2007 / Random-walk computation of similarities between nodes of a graph with application to collaborative recommendation / IEEE Transactions on Knowledge and Data Engineering 19 (3) : 355~369

[book] B. Scholkopf / 2001 / Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond / MIT Press

[journal] M. Girolami / 2002 / Mercer kernel-based clustering in feature space / IEEE Transactions on Neural Networks 13 (3) : 780~784

[journal] M. Filippone / 2008 / A survey of kernel and spectral methods for clustering / Pattern Recognition 41 (1) : 176~190

[journal] J. Shi / 2000 / Normalized cuts and image segmentation / IEEE Transactions on Pattern Analysis and Machine Intelligence 2 (8) : 888~905

[journal] U. von Luxburg / 2007 / A tutorial on spectral clustering / Statistics and Computing 17 (4) : 395~416

[journal] 허경용 / 2008 / Magnifying Block Diagonal Structure for Spectral Clustering / 멀티미디어학회논문지 / 한국멀티미디어학회 11 (9) : 1302~1309

[report] I. S. Dhillon / 2005 / A unified view of kernel k-means, spectral clustering and graph cuts / University of Texas

[journal] M. Garey / 1982 / The complexity of the generalized Lloyd-Max problem / IEEE Transactions on Information Theory 28 (2) : 255~256

[confproc] J. He / 2004 / Initialization of cluster refinement algorithms: A review and comparative study / Proceedings of the 2004 IEEE International Joint Conference on Neural Networks : 297~302

[journal] A. Likas / 2003 / The global k-means clustering algorithm / Pattern Recognition 36 : 451~461

[confproc] G. Heo / 2010 / An Extension of Global Fuzzy C-means Using Kernel Methods / Proceedings of the 2010 IEEE International Conference on Fuzzy Systems : 690~695

[journal] X. L. Xie / 1991 / A validity measure for fuzzy clustering / IEEE Transactions on Pattern Analysis and Machine Intelligence 13 (8) : 841~847

[journal] M. Meila / 2007 / Comparing clusterings - an information based distance / Journal of Multivariate Analysis 98 (5) : 873~895

[journal] D. Pascual / 2010 / Cluster validation using information stability measures / Pattern Recognition Letters 31 : 454~461

[confproc] Q. Deng / 2010 / Dual threshold based unsupervised face image clustering / Proceedings of the 2nd International Conference on Industrial Mechatronics and Automation : 436~439

[journal] D. Jiang / 2004 / Cluster analysis for gene expression data: a survey / IEEE Transactions on Knowledge and Data Engineering 16 (11) : 1370~1386

[report] L. J. P. van der Maaten / 2009 / Dimensionality Reduction: A Comparative Review / Tilburg University
KCI Citation (4)

KJC Korea
Journal Central

Statistics

Tools