Mathematics and Statistics Vol. 10(1), pp. 222 - 232
DOI: 10.13189/ms.2022.100121
Reprint (PDF) (476Kb)

Expectation-Maximization Algorithm Estimation Method in Automated Model Selection Procedure for Seemingly Unrelated Regression Equations Models

Nur Azulia Kamarudin ^*, Suzilah Ismail , Norhayati Yusof
Department of Mathematics & Statistics, School of Quantitative Sciences, Universiti Utara Malaysia, 06010 UUM Sintok, Kedah, Malaysia

ABSTRACT

Model selection is the process of choosing a model from a set of possible models. The model's ability to generalise means it can fit both current and future data. Despite numerous emergences of procedures in selecting models automatically, there has been a lack of studies on procedures in selecting multiple equations models, particularly seemingly unrelated regression equations (SURE) models. Hence, this study concentrates on an automated model selection procedure for the SURE model by integrating the expectation-maximization (EM) algorithm estimation method, named SURE(EM)-Autometrics. This extension procedure was originally initiated from Autometrics, which is only applicable for a single equation. To assess the performance of SURE(EM)-Autometrics, simulation analysis was conducted under two strengths of correlation among equations and two levels of significance for a two-equation model with up to 18 variables in the initial general unrestricted model (GUM). Three econometric models have been utilised as a testbed for true specification search. The results were divided into four categories where a tight significance level of 1% had contributed a high percentage of all equations in the model containing variables precisely comparable to the true specifications. Then, an empirical comparison of four model selection techniques was conducted using water quality index (WQI) data. System selection to select all equations in the model simultaneously proved to be more efficient than single equation selection. SURE(EM)-Autometrics dominated the comparison by being at the top of the rankings for most of the error measures. Hence, the integration of EM algorithm estimation is appropriate in improving the performance of automated model selection procedures for multiple equations models.

KEYWORDS
Expectation-Maximization Algorithm, Automated Model Selection, Multiple Equations, Seemingly Unrelated Regression Equations

Cite This Paper in IEEE or APA Citation Styles
(a). IEEE Format:
[1] Nur Azulia Kamarudin , Suzilah Ismail , Norhayati Yusof , "Expectation-Maximization Algorithm Estimation Method in Automated Model Selection Procedure for Seemingly Unrelated Regression Equations Models," Mathematics and Statistics, Vol. 10, No. 1, pp. 222 - 232, 2022. DOI: 10.13189/ms.2022.100121.

(b). APA Format:
Nur Azulia Kamarudin , Suzilah Ismail , Norhayati Yusof (2022). Expectation-Maximization Algorithm Estimation Method in Automated Model Selection Procedure for Seemingly Unrelated Regression Equations Models. Mathematics and Statistics, 10(1), 222 - 232. DOI: 10.13189/ms.2022.100121.