Some new facts about sequential quadratic programming methods employing second derivatives

For the sequential quadratic programming method (SQP), we show that close to a solution satisfying the same assumptions that are required for its local quadratic convergence (namely uniqueness of the Lagrange multipliers and the second-order sufficient optimality condition), the direction given by the SQP subproblem using the Hessian of the Lagrangian is a descent direction for the standard l1 -penalty function. We emphasize that this property is not straightforward at all, because the Hessian of the Lagrangian need not be positive definite under these assumptions or, in fact, under any other reasonable set of assumptions. In particular, this descent property was not known previously, under any assumptions (even including the stronger linear independence constraint qualification, strict complementarity, etc.). We also check the property in question by experiments on nonconvex problems from the Hock–Schittkowski test collection for a model algorithm. While to propose any new and complete SQP algorithm is not our goal here, our experiments confirm that the descent condition, and a model method based on it, work as expected. This indicates that the new theoretical findings that we report might be useful for full/practical SQP implementations which employ second derivatives and linesearch for the l1 -penalty function. In particular, our results imply that in SQP methods where using subproblems without Hessian modifications is an option, this option has a solid theoretical justification at least on late iterations. © 2016 Informa UK Limited, trading as Taylor & Francis Group.

Izmailov A.F. 1, 2, 3 , Solodov M.V.4
Taylor and Francis Ltd.
Номер выпуска
  • 1 VMK Faculty, OR Department, Lomonosov Moscow State University, MSU, Uchebniy Korpus 2, Leninskiye Gory, Moscow, 119991, Russian Federation
  • 2 Peoples' Friendship University of Russia, Miklukho-Maklaya Str. 6, Moscow, 117198, Russian Federation
  • 3 Department of Mathematics, Physics and Computer Sciences, Derzhavin Tambov State University, TSU, Internationalnaya 33, Tambov, 392000, Russian Federation
  • 4 IMPA – Instituto Nacional de Matemática Pura e Aplicada, Estrada Dona Castorina 110, Jardim Botânico, Rio de Janeiro 22460-320, Brazil
Ключевые слова
descent direction; penalty function; quadratic convergence; sequential quadratic programming
Дата создания
Дата изменения
Постоянная ссылка

Другие записи