Convergence properties of the Barzilai and Borwein gradient method
| dc.contributor.advisor | Tapia, Richard A. | |
| dc.contributor.advisor | Dennis, John E., Jr. | |
| dc.creator | Raydan M., Marcos | |
| dc.date.accessioned | 2009-06-04T00:37:06Z | |
| dc.date.available | 2009-06-04T00:37:06Z | |
| dc.date.issued | 1991 | |
| dc.description.abstract | In a recent paper, Barzilai and Borwein presented a new choice of steplength for the gradient method. Their choice does not guarantee descent in the objective function and greatly speeds up the convergence of the method. We derive an interesting relationship between any gradient method and the shifted power method. This relationship allows us to establish the convergence of the Barzilai and Borwein method when applied to the problem of minimizing any strictly convex quadratic function (Barzilai and Borwein considered only 2-dimensional problems). Our point of view also allows us to explain the remarkable improvement obtained by using this new choice of steplength. For the two eigenvalues case we present some very interesting convergence rate results. We show that our Q and R-rate of convergence analysis is sharp and we compare it with the Barzilai and Borwein analysis. We derive the preconditioned Barzilai and Borwein method and present preliminary numerical results indicating that it is an effective method, as compared to the preconditioned Conjugate Gradient method, for the numerical solution of some special symmetric positive definite linear systems that arise in the numerical solution of Partial Differential Equations. | |
| dc.format.extent | 60 p. | en_US |
| dc.format.mimetype | application/pdf | |
| dc.identifier.callno | Thesis Math. Sci. 1991 Raydan | |
| dc.identifier.citation | Raydan M., Marcos. "Convergence properties of the Barzilai and Borwein gradient method." (1991) Diss., Rice University. <a href="https://hdl.handle.net/1911/16479">https://hdl.handle.net/1911/16479</a>. | |
| dc.identifier.uri | https://hdl.handle.net/1911/16479 | |
| dc.language.iso | eng | |
| dc.rights | Copyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder. | |
| dc.subject | Mathematics | |
| dc.subject | Operations research | |
| dc.title | Convergence properties of the Barzilai and Borwein gradient method | |
| dc.type | Thesis | |
| dc.type.material | Text | |
| thesis.degree.department | Mathematical Sciences | |
| thesis.degree.discipline | Engineering | |
| thesis.degree.grantor | Rice University | |
| thesis.degree.level | Doctoral | |
| thesis.degree.name | Doctor of Philosophy |
Files
Original bundle
1 - 1 of 1