Dragomir, Radu-Alexandru, Taylor, Adrien B., Aspremont, Alexandre d' and Bolte, Jérôme (2022) Optimal complexity and certification of Bregman first-order methods. Mathematical Programming, Vol. 194. pp. 41-83.

Preview

Text Download (702kB) | Preview

Abstract

We provide a lower bound showing that the O(1/k) convergence rate of the NoLips method (a.k.a. Bregman Gradient or Mirror Descent) is optimal for the class of problems satisfying the relative smoothness assumption. This assumption appeared in the recent developments around the Bregman Gradient method, where acceleration remained an open issue. The main inspiration behind this lower bound stems from an extension of the performance estimation framework of Drori and Teboulle (Mathematical Programming, 2014) to Bregman first-order methods. This technique allows computing worst-case scenarios for NoLips in the context of relatively-smooth minimization. In particular, we used numerically generated worst-case examples as a basis for obtaining the general lower bound.