A platform for research: civil engineering, architecture and urbanism
A platform for research: civil engineering, architecture and urbanism
Optimal subgradient methods: computational properties for large-scale linear inverse problems
Abstract This paper studies the computational properties of the optimal subgradient algorithm (OSGA) for applications of linear inverse problems involving high-dimensional data. First, such convex problems are formulated as a class of convex problems with multi-term composite objective functions involving linear mappings. Next, an efficient procedure for computing the first-order oracle for such problems is provided and OSGA is equipped with some prox-functions such that the OSGA subproblem is solved in a closed form. Further, a comprehensive comparison among the most popular first-order methods is given. Then, several Nesterov-type optimal methods (originally proposed for smooth problems) are adapted to solve nonsmooth problems by simply passing a subgradient instead of the gradient, where the results of these subgradient methods are competitive and totally interesting for solving nonsmooth problems. Finally, numerical results with several inverse problems (deblurring with isotropic total variation, elastic net, and -minimization) show the efficiency of OSGA and the adapted Nesterov-type optimal methods for large-scale problems. For the deblurring problem, the efficiency measures of the improvement on the signl-to-noise ratio and the peak signal-to-noise ratio are used. The software package implementing OSGA is publicly available.
Optimal subgradient methods: computational properties for large-scale linear inverse problems
Abstract This paper studies the computational properties of the optimal subgradient algorithm (OSGA) for applications of linear inverse problems involving high-dimensional data. First, such convex problems are formulated as a class of convex problems with multi-term composite objective functions involving linear mappings. Next, an efficient procedure for computing the first-order oracle for such problems is provided and OSGA is equipped with some prox-functions such that the OSGA subproblem is solved in a closed form. Further, a comprehensive comparison among the most popular first-order methods is given. Then, several Nesterov-type optimal methods (originally proposed for smooth problems) are adapted to solve nonsmooth problems by simply passing a subgradient instead of the gradient, where the results of these subgradient methods are competitive and totally interesting for solving nonsmooth problems. Finally, numerical results with several inverse problems (deblurring with isotropic total variation, elastic net, and -minimization) show the efficiency of OSGA and the adapted Nesterov-type optimal methods for large-scale problems. For the deblurring problem, the efficiency measures of the improvement on the signl-to-noise ratio and the peak signal-to-noise ratio are used. The software package implementing OSGA is publicly available.
Optimal subgradient methods: computational properties for large-scale linear inverse problems
Ahookhosh, Masoud (author)
Optimization and Engineering ; 19 ; 815-844
2018-03-10
30 pages
Article (Journal)
Electronic Resource
English
Structured convex optimization , Linear inverse problems , Sparse nonsmooth optimization , First-order information , Subgradient methods , Optimal complexity , High-dimensional data Mathematics , Optimization , Engineering, general , Systems Theory, Control , Environmental Management , Operations Research/Decision Theory , Financial Engineering
Optimal subgradient methods: computational properties for large-scale linear inverse problems
| Springer Verlag | 2018
Optimal subgradient methods: computational properties for large-scale linear inverse problems
| Online Contents | 2018
Conditional subgradient methods for constrained quasi-convex optimization problems
| British Library Online Contents | 2016
Generalized Tikhonov Regularization Method for Large-Scale Linear Inverse Problems
| British Library Online Contents | 2013
Stochastic subgradient method for quasi-convex optimization problems
| British Library Online Contents | 2016