Behavior Research Methods vol:45 issue:1 pages:1-15
When analyzing data, researchers are often confronted with a model selection problem (e.g., determining the number of components/factors in PCA/factor analysis or identifying the
most important predictors in a regression analysis). To tackle such a problem, researchers may apply some objective procedure, like parallel analysis in PCA/factor analysis or stepwise selection methods in regression analysis. A drawback of these procedures is that they can only
be applied to the model selection problem at hand. An interesting alternative is the CHull model selection procedure, which was originally developed for multi-way analysis (e.g., multi-mode partitioning). However, the key idea behind the CHull procedure – identifying a model that optimally balances model goodness-of-fit/misfit and model complexity – is very generic. Therefore, the procedure may also be used when applying many other analysis techniques. The aim of this paper is two-fold. First, we will demonstrate the wide applicability of the CHull method by showing how it can be used to solve various model selection
problems in the context of PCA, Reduced K-means, best subset regression, and Partial least squares regression. Moreover, a comparison of CHull with standard model selection methods for these problems is performed. Second, we will present the CHULL software program, which may be downloaded from http://ppw.kuleuven.be/okp/software/CHULL/, to assist the user in applying the CHull procedure.