Method of independent multipliers for minimizing unconstrained functions

Date
1969
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract

A new accelerated gradient method for finding the minimum of a function f(x) whose variables are unconstrained is presented. The new algorithm can be stated where ax is the change in the position vector x, g(x) is the gradient of the function f(x), and a and fi are scalars chosen at each step so as to yield the greatest decrease in the function. The symbol Occ denotes the change in the position vector for the iteration preceding that under consideration. It is shown that, for a quadratic function, the present algorithm reduces to the Fletcher-Reeves algorithm; thus, quadratic convergence is assured. However, for a nonquadratic function, initial convergence of the present method is much faster than that of the Fletcher- Reeves method because of the extra degree of freedom available. For a test problem, the number of iterations was about 40-50% that of the Fletcher-Reeves method and the computing time about 60-75% that of the Fletcher-Reeves method, using comparable search techniques.

Description
Degree
Master of Science
Type
Thesis
Keywords
Citation

Cantrell, Joel Wood. "Method of independent multipliers for minimizing unconstrained functions." (1969) Master’s Thesis, Rice University. https://hdl.handle.net/1911/89122.

Has part(s)
Forms part of
Published Version
Rights
Copyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.
Link to license
Citable link to this page