- All Journals
- Al-Qadisiyah University
- Basrah University
- Kirkuk University
- Mosul University
- The Iraqi Borad for Medical Specialization
- University of Anbar
- University of Technology
- Al Mustafa University
- Al-Zahraa University for Women
- Alnoor University
- Kunooz University
- Misan University
- Ninevah University
- Tikrit University
- University of Al-Hamdaniya
- University of Kerbala
Improving the Learning Rate of the Back Propagation Algorithm by Aitkin Process | ||
| IRAQI JOURNAL OF STATISTICAL SCIENCES | ||
| Article 1, Volume 13, Issue 1, 2013, Pages 1-10 PDF (0 K) | ||
| DOI: 10.33899/iqjoss.2013.075434 | ||
| Author | ||
| Khalil K. Abbo | ||
| Abstract | ||
| The Back Propagation Algorithm is used for training feed Forward Multilayer Neural Networks (FFMNN).But often this algorithm takes long time to converge since it may fall into local minimu, for this reason we need a long time to train the network. The suitable choice of the learning rate helps us to escape from slow convergent for the BP and reduce the time of learning. In this paper, we derived a new adaptive learning rate for the BP algorithm, our derivation is based on the Aitkin's process. The most important distinct feature of our approach is the computing of the learning rate needs only first order derivatives and is suitable for large training sets and large networks. Its efficiency is proved on the standard test functions including heart , XOR and function approximation problems . | ||
|
Statistics Article View: 404 PDF Download: 314 |
||