- All Journals
- Al-Qadisiyah University
- Basrah University
- Kirkuk University
- Mosul University
- The Iraqi Borad for Medical Specialization
- University of Anbar
- University of Technology
- Al Mustafa University
- Al-Zahraa University for Women
- Alnoor University
- Kunooz University
- Misan University
- Ninevah University
- Tikrit University
- University of Al-Hamdaniya
- University of Kerbala
A New Convex Estimator Combining Ridge and Ordinary Least Squares Estimators | ||
| Journal of University of Anbar for Pure Science | ||
| Volume 18, Issue 2, December 2024, Pages 265-270 PDF (659.81 K) | ||
| Document Type: Research Paper | ||
| DOI: 10.37652/juaps.2024.149465.1250 | ||
| Authors | ||
| Karam K Al-janabi* ; Mustafa I. N. Alheety | ||
| Department of Mathematics, College of education for pure science, University of Anbar, Anbar, Iraq | ||
| Abstract | ||
| In the presence of high correlation between the independent variables in the linear regression model, which is known as the multicollinearity problem, the ordinary least squares estimator produce large variations in the sample. To overcome this problem, several estimators have been recommended. One of these estimators that has been proposed to reduce the impact of the multicollinearity problem was the estimator of the ridge regression, which leads to biased estimated coefficients, but it has a smaller variance than ordinary least squares estimators, which may have a smaller mean square error (MSE). In this paper, a new estimator has been proposed that combines ridge regression and ordinary least squares estimators. The performance of the recommended estimator is evaluated using the mean square error criterion after obtaining its properties. It has been shown that this estimator outperforms to both the ordinary least squares as well as the ridge regression estimators in terms of mean square error. In addition, the performance of this proposed estimator was studied by using a simulation study and a set of real data to demonstrate the theoretical results. | ||
| Keywords | ||
| Linear Regression Model; Ridge Estimator; Multicollinearity; Convex estimator | ||
| References | ||
|
[1] Alkhamisi, M., Khalaf, G., & Shukur, G. (2006). Some modifications for choosing ridge parameters. Communications in Statistics – Theory and Methods,35(11), 2005-2020.
[2] Hoerl, A. E., & Kennard, R. W. (1970). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12(1), 55-67.
[3] Kaçıranlar, S., Dawoud, I., & Karapınar, D. (2021). Linear Convex Combination Estimators and Comparisons. Adıyaman University Journal of Science, 11(2), 302-320.
[4] Özkale, M. R., & Kaciranlar, S. (2007). The restricted and unrestricted two-parameter estimators. Communications in Statistics—Theory and Methods, 36(15), 2707-2725.
[5] Odell, P. L., Dorsett, D., Young, D., & Igwe, J. (1989). Estimator models for combining vector estimators. Mathematical and Computer Modeling, 12(12), 1627-1642.
[6] Lattef, M. N., & ALheety, M. I. (2020). Study of some kinds of ridge regression estimators in linear regression model. Tik. J. of Pure Sci., 25(5), 130-142.
[7] Hoerl, A. E., Kannard, R. W., & Baldwin, K. F. (1975). Ridge regression: some simulations. Communications in Statistics-Theory and Methods, 4(2), 105-123.
[8] JF, L., & P, W. (1976). A simulation study of ridge and other regression estimators. Communications in Statistics-theory and Methods, 5(4), 307-323.
[9] Mohammad, B. A., & Naif, M. I. (2021). A simulation study of some restricted estimators in restricted linear regression model. Tikrit Journal of Pure Science, 26(3), 89-101.
[10] Woods, H., Steinour, H. H., & Starke, H. R. (1932). Effect of composition of Portland cement on heat evolved during hardening. Industrial & Engineering Chemistry, 24(11), 1207-1214.
[11] Alheety, M. I., & Gore, S. D. (2008). A new estimator in multiple linear regression model. Model Assisted Statistics and Applications, 3(3), 187-200.
[12] Alheety, M. I., & Kibria, B. G. (2009). On the Liu and almost unbiased Liu estimators in the presence of multicollinearity with heteroscedastic or correlated errors. Surveys in Mathematics and its Applications, 4, 155-167.
[13] Hocking, R. R., Speed, F. M., & Lynn, M. J. (1976). A class of biased estimators in linear regression. Technometrics, 18(4),55-67. | ||
|
Statistics Article View: 687 PDF Download: 169 |
||