Mathematics and Statistics Vol. 11(1), pp. 92 - 100
DOI: 10.13189/ms.2023.110110
Reprint (PDF) (260Kb)

ANOVA Assisted Variable Selection in High-dimensional Multicategory Response Data

Demudu Naganaidu ^1,*, Zarina Mohd Khalid ^2
1 Centre for Postgraduate Studies, Asia Metropolitan University, Malaysia
² Department of Mathematical Sciences, Faculty of Science, Universiti Teknologi Malaysia, Malaysia

ABSTRACT

Multinomial logistic regression is preferred in the classification of multicategory response data for its ease of interpretation and the ability to identify the associated input variables for each category. However, identifying important input variables in high-dimensional data poses several challenges as the majority of variables are unnecessary in discriminating the categories. Frequently used techniques in identifying important input variables in high-dimensional data include regularisation techniques such as Least Absolute Selection Shrinkage Operator (LASSO) and sure independent screening (SIS) or combinations of both. In this paper, we propose to use ANOVA, to assist the SIS in variable screening for high-dimensional data when the response variable is multicategorical. The new approach is straightforward and computationally effective. Simulated data without and with correlation are generated for numerical studies to illustrate the methodology, and the results of applying the methods on real data are presented. In conclusion, ANOVA performance is comparable with SIS in variable selection for uncorrelated input variables and performs better when used in combination with both ANOVA and SIS for correlated input variables.

KEYWORDS
ANOVA, High-dimensional Data, Sure Independence Screening, LASSO, Multinomial Logistic Regression

Cite This Paper in IEEE or APA Citation Styles
(a). IEEE Format:
[1] Demudu Naganaidu , Zarina Mohd Khalid , "ANOVA Assisted Variable Selection in High-dimensional Multicategory Response Data," Mathematics and Statistics, Vol. 11, No. 1, pp. 92 - 100, 2023. DOI: 10.13189/ms.2023.110110.

(b). APA Format:
Demudu Naganaidu , Zarina Mohd Khalid (2023). ANOVA Assisted Variable Selection in High-dimensional Multicategory Response Data. Mathematics and Statistics, 11(1), 92 - 100. DOI: 10.13189/ms.2023.110110.