New Method of Variable Selection for Binary Data Cluster Analysis
Languages of publication
Cluster analysis of binary data is a relatively poorly developed task in comparison with cluster analysis for data measured on stronger scales. For example, at the stage of variable selection one can use many methods arranged for arbitrary measurement scales but the results are usually of poor quality. In practice, the only methods dedicated for variable selection for binary data are the ones proposed by Brusco (2004), Dash et al. (2000) and Talavera (2000). In this paper the efficiency of these methods will be discussed with reference to the marketing type data of Dimitriadou et al. (2002). Moreover, the primary objective is a new proposal of variable selection method based on connecting the filtering of the input set of all variables with grouping of sets of variables similar with respect to similar groupings of objects. The new method is an attempt to link good features of two entirely different approaches to variable selection in cluster analysis, i.e. filtering methods and wrapper methods. The new method of variable selection returns best results when the classical k-means method of objects grouping is slightly modified.
- CARMONE, F., KARA, A., MAXWELL, S., (1999). HINoV: A New Model to Improve Market Segment Definition by Identifying Noisy Variables, Journal of Marketing Research, Vol. 36, No. 4, 501–510.
- DASH, M., LIU, H., (2000). Feature selection for clustering, Proceedings of Fourth Pacific-Asia Conference on Knowledge Discovery and Data Mining, (PAKDD), 110–121.
- DEVANEY, M., RAM, A., (1997). Efficient feature selection in conceptual clustering, Proceedings of the Fourteenth International Conference on Machine Learning, Nashville, 92–97.
- DIMITRIADOU, E., DOLNICAR, S., WEINGESSEL, A., (2002). An Examination of Indexes for Determining the Number of Clusters in Binary Data Sets, Psychometrika 67(1), 137–160.
- HUBERT, L., ARABIE, P., (1985). Comparing Partitions, Journal of Classification 2.
- LEISCH, F., WEINGESSEL, A., HORNIK, K., (2015). Bindata package manual.
- KORZENIEWSKI, J., (2012). Selekcja zmiennych w analizie skupień. [The selection of variables in cluster analysis]. Nowe procedury, Wydawnictwo Uniwersytetu Łódzkiego, Łódź.
- RAFTERY, E., DEAN, N., (2006). Variable selection for model-based clustering, Journal of the American Statistical Association , 101(473): 168–178.
- STEINLEY, D., BRUSCO, M., (2007). Initializing k-means batch clustering: A critical evaluation of several techniques, Journal of Classification 24, 99–121.
- STEINLEY, D., BRUSCO, M., (2008). Selection of Variables in Cluster Analysis: An Empirical Comparison of Eight Procedures, Psychometrika 73, 125–144.
- TALAVERA, L., (2000). Dependency-Based Feature Selection for Clustering Symbolic Data, Intelligent Data Analysis 4, 19–28.
Publication order reference