Mathematics and Statistics Vol. 9(5), pp. 630 - 638
DOI: 10.13189/ms.2021.090502
Reprint (PDF) (891Kb)

A Monte Carlo Study for Dealing with Multicollinearity and Autocorrelation Problems in Linear Regression Using Two Stage Ridge Regression Method

Hussein Eledum ^1,*, Hytham Hussein Awadallah ^2
1 Department of Statistics, Faculty of Science, University of Tabuk, Saudi Arabia
² Department of Applied Statistics, Faculty of Science and Technology, Shendi University, Sudan

ABSTRACT

In the multiple linear regression model, the problem of multicollinearity may come together with autocorrelation; therefore, several methods of estimation are developed to deal with this case; Two-Stage Ridge Regression (TR) is one of them. This article's main objective is to run a Monte Carlo simulation to investigate the impact of both problems, Multicollinearity and Autocorrelation, in multiple linear regression model on the performance of the TR. The simulation is carried out under different levels of multicollinearity, and sets of autocorrelation coefficient, taking into account different sample sizes. Some new properties for the TR method, including expectation, variance and mean square error, are droved. In contrast, the study also has developed some techniques to estimate the biasing parameter for the TR by modifying some popular techniques used in ridge regression (RR). Moreover, Mean Square Error is used as a base for evaluation and comparison. The empirical findings from the simulations revealed that the TR estimator performs better than the RR, and the values of the biasing parameter under the TR are always less than that under the RR. This paper contributes to the existing literature on developing new estimation methods used to overcome the presence of mixed problems in a linear regression model and studying their properties.

KEYWORDS
Autocorrelation, Multicollinearity, Ridge Regression, Two Stages, Monte Carlo Simulation

Cite This Paper in IEEE or APA Citation Styles
(a). IEEE Format:
[1] Hussein Eledum , Hytham Hussein Awadallah , "A Monte Carlo Study for Dealing with Multicollinearity and Autocorrelation Problems in Linear Regression Using Two Stage Ridge Regression Method," Mathematics and Statistics, Vol. 9, No. 5, pp. 630 - 638, 2021. DOI: 10.13189/ms.2021.090502.

(b). APA Format:
Hussein Eledum , Hytham Hussein Awadallah (2021). A Monte Carlo Study for Dealing with Multicollinearity and Autocorrelation Problems in Linear Regression Using Two Stage Ridge Regression Method. Mathematics and Statistics, 9(5), 630 - 638. DOI: 10.13189/ms.2021.090502.