An efficient line search for nonlinear least squares
Journal of Optimization Theory and Applications
Practical methods of optimization; (2nd ed.)
Practical methods of optimization; (2nd ed.)
Independent component analysis, a new concept?
Signal Processing - Special issue on higher order statistics
Adaptive blind separation of independent sources: a deflation approach
Signal Processing
A fast fixed-point algorithm for independent component analysis
Neural Computation
The Geometry of Algorithms with Orthogonality Constraints
SIAM Journal on Matrix Analysis and Applications
Independent component analysis: algorithms and applications
Neural Networks
Swarm intelligence
Optimization by Vector Space Methods
Optimization by Vector Space Methods
Guided Local Search — an Illustrative Example in Function Optimisation
BT Technology Journal
Constrained Clustering as an Optimization Method
IEEE Transactions on Pattern Analysis and Machine Intelligence
Optimal Linear Representations of Images for Object Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
Descent methods for optimization on homogeneous manifolds
Mathematics and Computers in Simulation
Automatic dimensionality selection from the scree plot via the use of profile likelihood
Computational Statistics & Data Analysis
Riemannian optimization method on the flag manifold for independent subspace analysis
ICA'06 Proceedings of the 6th international conference on Independent Component Analysis and Blind Signal Separation
Efficient feedback methods for MIMO channels based on parameterization
IEEE Transactions on Wireless Communications
Evolutionary computation: comments on the history and current state
IEEE Transactions on Evolutionary Computation
Combining mutation operators in evolutionary programming
IEEE Transactions on Evolutionary Computation
Evolutionary programming made faster
IEEE Transactions on Evolutionary Computation
The particle swarm - explosion, stability, and convergence in amultidimensional complex space
IEEE Transactions on Evolutionary Computation
Comprehensive learning particle swarm optimizer for global optimization of multimodal functions
IEEE Transactions on Evolutionary Computation
IEEE Transactions on Information Theory
Fast and robust fixed-point algorithms for independent component analysis
IEEE Transactions on Neural Networks
Self-stabilized gradient algorithms for blind source separation with orthogonality constraints
IEEE Transactions on Neural Networks
| Hi-index | 0.00 |
This paper presents a new stochastic algorithm to optimize the independence criterion--mutual information--among multivariate data using local, global, and hybrid optimizers, in conjunction with techniques involving a Lie group and its corresponding Lie algebra, for implicit imposition of the orthonormality constraint among the estimated sources. The major advantage of the proposed algorithm is the increased accuracy with which the weight matrix in the independent component analysis (ICA) model is estimated, compared to conventional schemes. When the local optimizer with Lie group techniques and the fast fixed-point (fastICA) algorithm were experimented by inputting the same set of random vectors, the former method superseded the conventional one by producing accurate weight matrix estimates in a majority of the test cases. Importantly, in our approach, the use of a Lie group to "lock" the weight matrix estimates onto the constraint surface enabled easy realization of the hybrid optimizers to yield near-global-optimum solutions consistently in most of the test cases, compared to well-known global optimizers. The inherent computational overhead in the hybrid optimizers was lowered by preprocessing the input data and periodically integrating the local optimizers with the global one. The proposed algorithms were applied to six-dimensional multispectral satellite image data to emphasize their usefulness in terms of accurate ICA weight matrix estimation.