Contents
Davidon–Fletcher–Powell formula
The Davidon–Fletcher–Powell formula (or DFP; named after William C. Davidon, Roger Fletcher, and Michael J. D. Powell) finds the solution to the secant equation that is closest to the current estimate and satisfies the curvature condition. It was the first quasi-Newton method to generalize the secant method to a multidimensional problem. This update maintains the symmetry and positive definiteness of the Hessian matrix. Given a function f(x), its gradient (\nabla f), and positive-definite Hessian matrix B, the Taylor series is and the Taylor series of the gradient itself (secant equation) is used to update B. The DFP formula finds a solution that is symmetric, positive-definite and closest to the current approximate value of B_k: where and B_k is a symmetric and positive-definite matrix. The corresponding update to the inverse Hessian approximation is given by B is assumed to be positive-definite, and the vectors s_k^T and y must satisfy the curvature condition The DFP formula is quite effective, but it was soon superseded by the Broyden–Fletcher–Goldfarb–Shanno formula, which is its dual (interchanging the roles of y and s).
Compact representation
By unwinding the matrix recurrence for B_k, the DFP formula can be expressed as a compact matrix representation. Specifically, defining and upper triangular and diagonal matrices the DFP matrix has the equivalent formula The inverse compact representation can be found by applying the Sherman-Morrison-Woodbury inverse to B_k. The compact representation is particularly useful for limited-memory and constrained problems.
This article is derived from Wikipedia and licensed under CC BY-SA 4.0. View the original article.
Wikipedia® is a registered trademark of the
Wikimedia Foundation, Inc.
Bliptext is not
affiliated with or endorsed by Wikipedia or the
Wikimedia Foundation.