On solving large-scale polynomial convex problems by randomized first order algorithms

A. Ben-Tal, A. Nemirovski

Research output: Contribution to journalArticleScientificpeer-review

2 Citations (Scopus)

Abstract

One of the most attractive recent approaches to processing well-structured large-scale convex optimization problems is based on smooth convex-concave saddle point reformulation of the problem of interest and solving the resulting problem by a fast first order saddle point method utilizing smoothness of the saddle point cost function. In this paper, we demonstrate that when the saddle point cost function is polynomial, the precise gradients of the cost function required by deterministic first order saddle point algorithms and becoming prohibitively computationally expensive in the extremely large-scale case, can be replaced with incomparably cheaper computationally unbiased random estimates of the gradients. We show that for large-scale problems with favorable geometry, this randomization accelerates, progressively as the sizes of the problem grow, the solution process. This extends significantly previous results on acceleration by randomization, which, to the best of our knowledge, dealt solely with bilinear saddle point problems. We illustrate our theoretical findings by instructive and encouraging numerical experiments.
Original languageEnglish
Pages (from-to)474-494
JournalMathematics of Operations Research
Volume40
Issue number2
Publication statusPublished - 2015
Externally publishedYes

Fingerprint Dive into the research topics of 'On solving large-scale polynomial convex problems by randomized first order algorithms'. Together they form a unique fingerprint.

  • Cite this