Have a personal or library account? Click to login
A new conjugate gradient method for acceleration of gradient descent algorithms Cover

A new conjugate gradient method for acceleration of gradient descent algorithms

Open Access
|Nov 2020

References

  1. [1] M. Al-Baali, Descent property and global convergence of the Fletcher–Reeves method with inexact line search, IMA J. Numer. Anal. 5 (1985) 121–124.10.1093/imanum/5.1.121
  2. [2] N. Andrei, An unconstrained optimization test functions collection, Advanced Modeling and Optimization, An Electronic International Journal 10 (2008) 147–161.
  3. [3] M. Belloufi, R. Benzine, Descent property and global convergence of a new search direction method for unconstrained optimization, Numerical Functional Analysis and Optimization, 36(2), 169-180, Taylor & Francis Group 2014.10.1080/01630563.2014.976796
  4. [4] Sh. Sadigh Behzadi and A. Yildirim, Numerical solution of lr fuzzy hunter-saxeton equation by using homo-topy analysis method, Journal of Applied Analysis and Computation, 2012, Vol.2, (1):1-10.10.11948/2012001
  5. [5] R. Benouahboun, A. Mansouri, An interior point algorithm for convex quadratic programming with strict equilibrium. RAIRO Oper. Res. 39 (2005) 13-33.
  6. [6] M.Q. Chen, S. -P. Han, A parallel quasi-Newton method for partially separable large scale minimization, Annals of Operations Research, 1988, Volume 14, Issue 1, pp 195-211.10.1007/BF02186480
  7. [7] E. Dolan, J. J. Moré (2002). Benchmarking optimization software with performance profiles. Mathematical Programming 91:201–213.
  8. [8] Y. Dai, Convergence properties of the BFGS algorithm. SIAM Journal on Optimization, 13 (2003) 693–701.
  9. [9] J. E. Dennis, Jr., J. J. Moré, (1977). Quasi-Newton methods, motivation and theory. SIAM Review, 19, 46–89.10.1137/1019005
  10. [10] X. Dong, W.j. Li, Y.b. He, Some modified Yabe-Takano Conjugate gradient methods with Sufficient descent condition. RAIRO-Oper. Res. 2016.DOI: http://dx.doi.org/10.1051/ro/2016028.10.1051/ro/2016028
  11. [11] Sarra Delladji, Mohammed Belloufi, Badereddine Sellami, Behavior of the combination of PRP and HZ methods for unconstrained optimization, Numerical Algebra Control And Optimization, (2020), doi:10.3934/naco.202003210.3934/naco.2020032
  12. [12] Y.H. Dai, Y. Yuan, An Efficient Hybrid Conjugate Gradient Method for Unconstrained Optimization, Annals of Operations Research, March 2001, Volume 103, Issue 1-4, pp 33-4710.1023/A:1012930416777
  13. [13] S. Deng, Coercivity properties and well-posedness in vector optimization. RAIRO Oper. Res. 37 (2003) 195-208.
  14. [14] R. Fletcher, Practical Method of Optimization, second ed., Unconstrained Optimization, vol. I, Wiley, New York, 1997.
  15. [15] M.C. Ferris, A.J. Wathen, P. Armand, Limited memory solution of bound constrained convex quadratic problems arising in video games. RAIRO Oper. Res. 41 (2007) 19-34.
  16. [16] M.R. Hestenes, E. Stiefel, Method of conjugate gradient for solving linear equations, J. Res. Nat. Bur. Stand. 49 (1952) 409–436.10.6028/jres.049.044
  17. [17] W.W. Hager, H. Zhang, A new conjugate gradient method with guaranteed descent and an efficient line search, SIAM Journal on Optimization 16 (2005) 170–192.10.1137/030601880
  18. [18] S.B. Kafaki, R. Ghanbari, A descent hybrid modification of the Polak–Ribière–Polyak conjugate gradient method. RAIRO-Oper. Res. 50 (2016) 567-574.
  19. [19] Y. Liu, C. Storey, Efficient generalized conjugate gradient algorithms. Part 1: Theory, J. Optimiz. Theory Appl. 69 (1992) 129–137.10.1007/BF00940464
  20. [20] J. Nocedal, S.J. Wright, Numerical optimization, Springer Series in Operations Research, Springer, New York, 1999.10.1007/b98874
  21. [21] J. Nocedal, Conjugate gradient methods and nonlinear optimization, in: L. Adams, J.L. Nazareth (Eds.), Linear and Nonlinear Conjugate Gradient Related Methods, SIAM, Philadelphia, PA, 1995, pp. 9–23.
  22. [22] M.J.D. Powell, Nonconvex minimization calculations and the conjugate gradient method, Lecture Notes in Math. 1066 (1984) 121–141.
  23. [23] B.T. Polyak, The conjugate gradient method in extreme problems, USSR Comp. Math. Math. Phys. 9 (1969) 94–112.10.1016/0041-5553(69)90035-4
  24. [24] M. A. Rincon, M. I. M. Copetti, Numerical analysis for a locally damped wave equation, Journal of Applied Analysis and Computation, 2013, Vol.3, (2):169-182.10.11948/2013013
  25. [25] J. Schropp, A note on minimization problems and multistep methods. Numeric Mathematic, 78 (1997) 87–101.
  26. [26] N.H. Zhao, Y. Xia, W. Liu, P. J. Y. Wong and R. T. Wang, Existence of Almost Periodic Solutions of a Nonlinear System, Journal of Applied Analysis and Computation, 2013, Vol.3, (3):301-306.10.11948/2013022
  27. [27] Z.J. Shi, X.S. Zhang, J. Shen, Convergence analysis of adaptive trust region methods. RAIRO Oper. Res. 41 (2007) 105-121.
  28. [28] C. Xu, J. Zhang, A Survey of Quasi-Newton Equations and Quasi-Newton Methods for Optimization, Annals of Operations Research,2001, Volume 103, Issue 1-4, pp 213-234.
Language: English
Page range: 1 - 11
Submitted on: Jul 5, 2020
|
Accepted on: Oct 12, 2020
|
Published on: Nov 22, 2020
Published by: Sciendo
In partnership with: Paradigm Publishing Services
Publication frequency: 3 issues per year

© 2020 Noureddine Rahali, Mohammed Belloufi, Rachid Benzine, published by Sciendo
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.