CINECA IRIS Institutional Research Information System
IRIS è la soluzione IT che facilita la raccolta e la gestione dei dati relativi alle attività e ai prodotti della ricerca. Fornisce a ricercatori, amministratori e valutatori gli strumenti per monitorare i risultati della ricerca, aumentarne la visibilità e allocare in modo efficace le risorse disponibili.
EnglishThis work is concerned with the cyclic block coordinate descent method, or nonlinear Gauss-Seidel method, where the solution of an optimization problem is achieved by partitioning the variables in blocks and successively minimizing with respect to each block. The properties of the objective function that guarantee the convergence of such alternating scheme have been widely investigated in the literature and it is well known that, without suitable convexity hypotheses, the method may fail to locate the stationary points when more than two blocks of variables are employed. In this paper the general constrained non convex case is considered and three contributions are given. First, a general method allowing an approximate solution of each block minimization subproblem is devised and the related convergence analysis is developed, showing that the proposed inexact method has the same convergence properties of the standard nonlinear Gauss-Seidel method. Then, a cyclic block gradient projection method is analyzed, proving that it leads to stationary points for every number of blocks. Finally, the cyclic block gradient method is applied to large scale problems arising from the nonnegative matrix factorization approach. The results of a numerical experimentation on image recognition problems are also reported.
| Data di pubblicazione: | 2011 | |
| Titolo: | Inexact block coordinate descent methods with application to the nonnegative matrix factorization | |
| Autori: | S. Bonettini | |
| Rivista: | IMA JOURNAL OF NUMERICAL ANALYSIS | |
| Parole Chiave: | Numerical Analysis; Constrained Optimization; Gradient Projection Methods | |
| Abstract: | This work is concerned with the cyclic block coordinate descent method, or nonlinear Gauss-Seidel method, where the solution of an optimization problem is achieved by partitioning the variables in blocks and successively minimizing with respect to each block. The properties of the objective function that guarantee the convergence of such alternating scheme have been widely investigated in the literature and it is well known that, without suitable convexity hypotheses, the method may fail to locate the stationary points when more than two blocks of variables are employed. In this paper the general constrained non convex case is considered and three contributions are given. First, a general method allowing an approximate solution of each block minimization subproblem is devised and the related convergence analysis is developed, showing that the proposed inexact method has the same convergence properties of the standard nonlinear Gauss-Seidel method. Then, a cyclic block gradient projection method is analyzed, proving that it leads to stationary points for every number of blocks. Finally, the cyclic block gradient method is applied to large scale problems arising from the nonnegative matrix factorization approach. The results of a numerical experimentation on image recognition problems are also reported. | |
| Digital Object Identifier (DOI): | 10.1093/imanum/drq024 | |
| Handle: | http://hdl.handle.net/11392/1399127 | |
| Appare nelle tipologie: | 03.1 Articolo su rivista |
File in questo prodotto:
http://hdl.handle.net/11392/1399127
Copyright © 2022