A Riemannian BFGS Method for Nonconvex Optimization Problems


Wen Huang, P.-A. Absil, K. A. Gallivan


In this paper, a Riemannian BFGS method is defined for minimizing a smooth function on a Riemannian manifold endowed with a retraction and a vector transport. The method is based on a Riemannian generalization of a cautious update and a weak line search condition. It is shown that the Riemannian BFGS method converges (i) globally to a stationary point without assuming that the objective function is convex and (ii) superlinearly to a nondegenerate minimizer. The weak line search condition completely exempts us from resorting to the differentiated retraction. The joint diagonalization problem is used to demonstrate the performance of the algorithm with various parameters, line search conditions, and pairs of retraction and vector transport.

Key words

Riemannian optimization; manifold optimization; Quasi-Newton methods; BFGS method; Stiefel manifold, Soft ICA;


Lecture Notes in Computational Science and Engineering, to appear, 2016.


BibTex entry