Parallel Software for Training Large Scale Support Vector Machines on Multiprocessor Systems
The Journal of Machine Learning Research
Solving bound constrained optimization via a new nonmonotone spectral projected gradient method
Applied Numerical Mathematics
Improving ultimate convergence of an augmented Lagrangian method
Optimization Methods & Software - Dedicated to Professor Michael J.D. Powell on the occasion of his 70th birthday
Modified subspace limited memory BFGS algorithm for large-scale bound constrained optimization
Journal of Computational and Applied Mathematics
Computational Intelligence and Neuroscience - Advances in Nonnegative Matrix and Tensor Factorization
Hybrid spectral gradient method for the unconstrained minimization problem
Journal of Global Optimization
On Nonmonotone Chambolle Gradient Projection Algorithms for Total Variation Image Restoration
Journal of Mathematical Imaging and Vision
Sparse reconstruction by separable approximation
IEEE Transactions on Signal Processing
A new two-step gradient-type method for large-scale unconstrained optimization
Computers & Mathematics with Applications
Duality-based algorithms for total-variation-regularized image restoration
Computational Optimization and Applications
A multivariate spectral projected gradient method for bound constrained optimization
Journal of Computational and Applied Mathematics
Computers & Mathematics with Applications
A box constrained gradient projection algorithm for compressed sensing
Signal Processing
Fast Projections onto l1,q-norm balls for grouped feature selection
ECML PKDD'11 Proceedings of the 2011 European conference on Machine learning and knowledge discovery in databases - Volume Part III
Uni-orthogonal nonnegative tucker decomposition for supervised image classification
ICIAP'11 Proceedings of the 16th international conference on Image analysis and processing: Part I
Analysis and Generalizations of the Linearized Bregman Method
SIAM Journal on Imaging Sciences
Some projection methods with the BB step sizes for variational inequalities
Journal of Computational and Applied Mathematics
A Barzilai-Borwein-based heuristic algorithm for locating multiple facilities with regional demand
Computational Optimization and Applications
The Chaotic Nature of Faster Gradient Descent Methods
Journal of Scientific Computing
A cyclic projected gradient method
Computational Optimization and Applications
Modified subspace Barzilai-Borwein gradient method for non-negative matrix factorization
Computational Optimization and Applications
An active set truncated Newton method for large-scale bound constrained optimization
Computers & Mathematics with Applications
Hi-index | 0.01 |
This paper studies projected Barzilai-Borwein (PBB) methods for large-scale box-constrained quadratic programming. Recent work on this method has modified the PBB method by incorporating the Grippo-Lampariello-Lucidi (GLL) nonmonotone line search, so as to enable global convergence to be proved. We show by many numerical experiments that the performance of the PBB method deteriorates if the GLL line search is used. We have therefore considered the question of whether the unmodified method is globally convergent, which we show not to be the case, by exhibiting a counter example in which the method cycles. A new projected gradient method (PABB) is then considered that alternately uses the two Barzilai-Borwein steplengths. We also give an example in which this method may cycle, although its practical performance is seen to be superior to the PBB method. With the aim of both ensuring global convergence and preserving the good numerical performance of the unmodified methods, we examine other recent work on nonmonotone line searches, and propose a new adaptive variant with some attractive features. Further numerical experiments show that the PABB method with the adaptive line search is the best BB-like method in the positive definite case, and it compares reasonably well against the GPCG algorithm of Moré and Toraldo. In the indefinite case, the PBB method with the adaptive line search is shown on some examples to find local minima with better solution values, and hence may be preferred for this reason.