skip to main content
article
Free Access

Methods to speed up error back-propagation learning algorithm

Published:01 December 1995Publication History
First page image

References

  1. ANAND, R., MEHROTTRA, K. G., MOHAN, C. K., AND Rn_NKA, S. 1993. An improved algorithm for neural network classification of imbalanced training sets. IEEE Trans. Neural Netw. 4.Google ScholarGoogle Scholar
  2. AHMAD, M. AND S~, F. M.A. 1992a. }Dynamic learning using exponential energy function. In Proceedings of the International Joint Conference on Neural Networks.Google ScholarGoogle Scholar
  3. AHMAD, M. AND SALAM, F. M. A. 1992b. Error back-propagation learning using the polynomial energy function. In Proceedings of the fourth International Conference on System Engineering.Google ScholarGoogle Scholar
  4. AHMAD, M. AND SALAM, F. M. A. 1992c. Supervised learning using the Cauchy energy function. In Proceedings of the International Conference on Fuzzy Logic and Neural Networks.Google ScholarGoogle Scholar
  5. BATTITI, R. 1992. First- and second-order methods for learning: Between steepest descent and Newton's method. Neural Comput. 4. Google ScholarGoogle Scholar
  6. BATTITI, R. 1989. Accelerated backpropagation learning: Two optimization methods. Complex Syst. 3.Google ScholarGoogle Scholar
  7. BRYSON, A. E. AND Ho, Y.C. 1969. Applied Optimal Control. Waltham MA.Google ScholarGoogle Scholar
  8. DEVOS, M. R. AND ORBAN, G.A. 1988. Self learning backpropagation. In Proceedings of the NeuroNimes.Google ScholarGoogle Scholar
  9. EATON, H. A. C. AND OLIVIER, T.L. 1992. Learning coefficient dependence on training set size. Neural Netw. 5. Google ScholarGoogle Scholar
  10. FAHLMAN, S. E. 1988. An empirical study of learning speed in back-propagation networks. Tech. Rep. CMU-CS-88-162, Carnegie Mellon University, Pittsburgh, PA.Google ScholarGoogle Scholar
  11. HINTON, G.E. 1989. Connectionist learning procedures. Artif. InteU. 40. Google ScholarGoogle Scholar
  12. HINTON, G.E. 1987. Learning translation invariant recognition in massively parallel networks. In Lecture Notes in Computer Science. Springer-Verlag. Google ScholarGoogle Scholar
  13. HOLT, M. J. J. AND SEMNANI, S. 1990. Convergence of back-propagation in neural networks using a log-likelihood cost function. Electron. Lett. 26.Google ScholarGoogle Scholar
  14. JACOBS, R. A. 1988. Increased rate of convergence through learning rate adaptation. Neural Netw. 1.Google ScholarGoogle Scholar
  15. KINSELLA, J. A. 1992. Comparison and evaluation of variants of the conjugate gradient method for learning in feed-forward neural networks with backward error propagation. Network 3.Google ScholarGoogle Scholar
  16. LE CUN, Y. 1988. A theoretical framework for backpropagation. In Proceedings of the 1988 Connectionist Models Summer School.Google ScholarGoogle Scholar
  17. LE CUN, Y. 1986. Learning process in an asymmetric threshold network. In Disordered Systems and B~ological Organization, Springer- Verlag.Google ScholarGoogle Scholar
  18. LIPPMANN, R. P. 1987. An introduction to computing with neural network. IEEE ASSP Mag. (April), 4-22.Google ScholarGoogle Scholar
  19. MINAI, A. A. AND WILLIAMS, R.D. 1990a. Acceleration of back-propagation through learning rate and momentum adaptation, in Proceedings of the International Joint Conference on Neural Networks (Washington, DC).Google ScholarGoogle Scholar
  20. MINAI, A. A. AND WILLIAMS, R. D. 1990b. Backpropagation heuristics: A study of the extended delta-bar-delta algorithm. In Proceedings of the International Joint Conference on Neural Networks (San Diego, CA).Google ScholarGoogle Scholar
  21. PARKER, D. B. 1985. Learning logic. Tech. Rep. MIT, Cambridge, MA.Google ScholarGoogle Scholar
  22. PIREZ, Y. M. AND SARKAR, D. 1991. Back-propagation with controlled oscillation of weights. Tech. Rep. TR-CS-01-91, University of Miami, FL.Google ScholarGoogle Scholar
  23. RIGLER, A. K., IRVINE, J. M., AND VOGL, T.P. 1991. Rescahng of variables in back propagation learning. Neural Netw. 4. Google ScholarGoogle Scholar
  24. RUMELHART, D. H., HINTON, G. E., AND WILLIAMS, R.J. 1986. Learning internal representation by error propagation. In Parallel Distrtbuted Processing: Explorations ~n the Microstructures of Cognition, vol. 1. MIT Press, Cambridge, MA. Google ScholarGoogle Scholar
  25. RUMELHART, D. E., MCCLELLAND, J. L., ST AL. 1986. Parallel Distributed Processing: Explorations in the Mtcrostructures of Cognition, vol. 1. MIT Press, Cambridge, MA. Google ScholarGoogle Scholar
  26. SAMAD, T.1991. Back propagation with expected source values. Neural Netw. 4. Google ScholarGoogle Scholar
  27. S~NNO, D. F. 1978. Conjugate gradient methods with inexact searches. Math. Oper. Res. 3.Google ScholarGoogle Scholar
  28. SIETSMA, J. AND DOW, R.J. 1991. Creating artificial neural networks that generalize. Neural Netw. 4. Google ScholarGoogle Scholar
  29. SOLLA, S. A., LEVIN, E., AND FLEISHER, M. 1988. Accelerated learning in layered neural networks. Complex Syst. 2. Google ScholarGoogle Scholar
  30. TESAURO, G. 1987. Scaling relationships in back-propagation learning: Dependence on training set size. Complex Syst. 1. Google ScholarGoogle Scholar
  31. TESAURO, G. AND JANSSENS, B. 1988. Scaling relationships in back-propagation learning. Complex Syst. 2. Google ScholarGoogle Scholar
  32. TOLLENAERE, T. 1990. SuperSAB: Fast adaptive back propagation with good scaling properties. Neural Netw. 3. Google ScholarGoogle Scholar
  33. vAN OOYEN, A. AND NIENHUIS, B. 1992. Improving the convergence of the back-propagation algorithm. Neural Netw. 5. Google ScholarGoogle Scholar
  34. WATROUS, R. 1988. Learning algorithms for connectionist networks: Applied gradient methods for nonlinear optimization. Tech. Rep. MS-SIS- 88-62, Univ. of Pennsylvania.Google ScholarGoogle Scholar
  35. WEIR, M.K. 1991. A method for self-determination of adaptive learning rates in back propagation. Neural Netw. 4. Google ScholarGoogle Scholar
  36. WERBOS, P.J. 1974. Beyond regresszon: New tool for prediction and analysis in the behavioral sciences. Ph.D. thesis, Harvard Univ.Google ScholarGoogle Scholar
  37. WERBOS, P. J. 1990. Backpropagation through time: What it does and how to do it. In Proceedings of the IEEE 78.Google ScholarGoogle Scholar
  38. WIDROW, B. AND LEHR, M.A. 1990. 30 years of adaptive neural networks: Perceptron, madline, and backpropagation. In Proceedings of the IEEE 78.Google ScholarGoogle Scholar

Index Terms

  1. Methods to speed up error back-propagation learning algorithm

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader