- All Journals
- Al-Qadisiyah University
- Basrah University
- Kirkuk University
- Mosul University
- The Iraqi Borad for Medical Specialization
- University of Anbar
- University of Technology
- Al Mustafa University
- Al-Zahraa University for Women
- Alnoor University
- Kunooz University
- Misan University
- Ninevah University
- Tikrit University
- University of Al-Hamdaniya
- University of Kerbala
The performance of some new estimated ridge parameter regression model | ||
| Journal of University of Anbar for Pure Science | ||
| Volume 19, Issue 1 - Serial Number 19, May and June 2025, Pages 304-316 PDF (1.16 M) | ||
| Document Type: Research Paper | ||
| DOI: 10.37652/juaps.2024.151225.1280 | ||
| Authors | ||
| Fatima Salih ALfahdawe* ; Mustafa I. N. Alheety | ||
| Department of Mathematics, College of education for pure science, University Of Anbar, Anbar, Iraq | ||
| Abstract | ||
| In the presence of high correlation between the independent variables in the linear regression model, which is known as the multicollinearity problem, the ordinary least squares estimator produces large variations in the sample. To overcome this problem, several estimators have been recommended. One of these estimators that has been proposed to reduce the impact of the multicollinearity problem was the estimator of the ridge regression, which leads to biased estimated coefficients, but it has a smaller variance than ordinary least squares estimators, which may have a smaller mean square error (MSE). In this paper, we review 50 kinds of ridge parameter (m) that a use for estimating the ordinary ridge regression estimator (ORR) in addition to that, we propose 10 of new types of m based on different approaches. Both of simulation study and numerical example are used to compare these estimators of m using estimated of mean squared error (EMSE) to study the performance of them. The Simulation and on example results show that, the new proposed estimators of m can be used instead of audit others. | ||
| Keywords | ||
| Linear Regression Model; Ridge Estimator; Multicollinearity; Mean squared error; Monte Carlo simulations | ||
| References | ||
|
[1] Kibria, B. G. (2003). Performance of some new ridge regression estimators. Communications in Statistics-Simulation and Computation, 32(2), 419-435.
[2] Lattef, M. N., & ALheety, M. I. (2020). Study of some kinds of ridge regression estimators in linear regression model. Tik. J. of Pure Sci., 25(5), 130-142.
[3] Hoerl, A. E., & Kennard, R. W. (1970). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12(1), 55-67.
[4] Hoerl, A. E., Kannard, R. W., & Baldwin, K. F. (1975). Ridge regression: some simulations. Communications in Statistics-Theory and Methods, 4(2), 105-123.
[5] McDonald, G. C., & Galarneau, D. I. (1975). A Monte Carlo evaluation of some ridge-type estimators. Journal of the American Statistical Association, 70(350), 407-416.
[6] Hocking, R. R., Speed, F. M., & Lynn, M. J. (1976). A class of biased estimators in linear regression. Technometrics, 18(4), 425-437.
[7] Theobald, C. M. (1974). Generalizations of mean square error applied to ridge regression. Journal of the Royal Statistical Society Series B: Statistical Methodology, 36(1), 103-106.
[8] JF, L., & P, W. (1976). A simulation study of ridge and other regression estimators. Communications in Statistics-theory and Methods, 5(4), 307-323.
[9] Schaefer, R. L., Roi, L. D., & Wolfe, R. A. (1984). A ridge logistic estimator. Communications in Statistics-Theory and Methods, 13(1), 99-113.
[10] Nomura, M. (1988). On the almost unbiased ridge regression estimator. Communications in Statistics-Simulation and Computation, 17(3), 729-743.
[11] Khalaf, G., & Shukur, G. (2005). Choosing ridge parameter for regression problems.
[12] Alkhamisi, M., Khalaf, G., & Shukur, G. (2006). Some modifications for choosing ridge parameters. Communications in Statistics-Theory and Methods, 35(11), 2005-2020.
[13] Alkhamisi, M. A., & Shukur, G. (2007). A Monte Carlo study of recent ridge parameters. Communications in Statistics—Simulation and Computation®, 36(3), 535-547.
[14] Muniz, G., & Kibria, B. G. (2009). On some ridge regression estimators: An empirical comparisons. Communications in Statistics—Simulation and Computation®, 38(3), 621-630.
[15] Dorugade, A. V., & Kashid, D. N. (2010). Alternative method for choosing ridge parameter for regression. Applied Mathematical Sciences, 4(9), 447-456.
[16] Al-Hassan, Y. M. (2010). Performance of a new ridge regression estimator. Journal of the Association of Arab Universities for Basic and Applied Sciences, 9(1), 23-26.
[17] Månsson, K., Kibria, B. G., & Shukur, G. (2014). Improved Ridge Regression Estimators for Binary Choice Models: An Empirical Study. International Journal of Statistics in Medical Research, 3(3), 257-265.
[18] Muniz, G., Kibria, B. M., & Shukur, G. (2012). On developing ridge regression parameters: a graphical investigation.
[19] Khalaf, G., Månsson, K., & Shukur, G. (2013). Modified ridge regression estimators. Communications in Statistics-Theory and Methods, 42(8), 1476-1487.
[20] Khalaf, G., & Iguernane, M. (2016). Multicollinearity and a ridge parameter estimation approach. Journal of Modern Applied Statistical Methods, 15(2), 25.
[21] Asar, Y., & Genç, A. (2017). A note on some new modifications of ridge estimators. Kuwait Journal of Science, 44(3).
[22] Dorugade, A. V. (2016). Improved ridge estimator in linear regression with multicollinearity, heteroscedastic errors and outliers. Journal of Modern Applied Statistical Methods, 15, 362-381.
[23] Woods, H., Steinour, H. H., & Starke, H. R. (1932). Effect of composition of Portland cement on heat evolved during hardening. Industrial &Engineering Chemistry, 24(11), 1207-1214.
[24] Alheety, M. I., & Gore, S. D. (2008). A new estimator in multiple linear regression model. Model Assisted Statistics and Applications, 3(3), 187-200.
[25] Alheety, M. I., & Kibria, B. G. (2009). On the Liu and almost unbiased Liu estimators in the presence of multicollinearity with heteroscedastic or correlated errors. Surveys in Mathematics and its Applications, 4, 155-167.
| ||
|
Statistics Article View: 512 PDF Download: 126 |
||