Independent component analysis, a new concept?
Signal Processing - Special issue on higher order statistics
Introduction to archetypal analysis of spatio-temporal dynamics
MSTD '95 Proceedings of the workshop on Measures of spatio-temporal dynamics
Dictionary learning algorithms for sparse representation
Neural Computation
Projected Gradient Methods for Nonnegative Matrix Factorization
Neural Computation
On the use of archetypes as benchmarks
Applied Stochastic Models in Business and Industry - Special issue on statistical methods in performance analysis
Making Archetypal Analysis Practical
Proceedings of the 31st DAGM Symposium on Pattern Recognition
Convex and Semi-Nonnegative Matrix Factorizations
IEEE Transactions on Pattern Analysis and Machine Intelligence
Computers and Industrial Engineering
Expert Systems with Applications: An International Journal
Hi-index | 0.01 |
Archetypal analysis (aa) proposed by Cutler and Breiman (1994) [7] estimates the principal convex hull (pch) of a data set. As such aa favors features that constitute representative 'corners' of the data, i.e., distinct aspects or archetypes. We currently show that aa enjoys the interpretability of clustering - without being limited to hard assignment and the uniqueness of svd - without being limited to orthogonal representations. In order to do large scale aa, we derive an efficient algorithm based on projected gradient as well as an initialization procedure we denote FurthestSum that is inspired by the FurthestFirst approach widely used for k-means (Hochbaum and Shmoys, 1985 [14]). We generalize the aa procedure to kernel-aa in order to extract the principal convex hull in potential infinite Hilbert spaces and derive a relaxation of aa when the archetypes cannot be represented as convex combinations of the observed data. We further demonstrate that the aa model is relevant for feature extraction and dimensionality reduction for a large variety of machine learning problems taken from computer vision, neuroimaging, chemistry, text mining and collaborative filtering leading to highly interpretable representations of the dynamics in the data. Matlab code for the derived algorithms is available for download from www.mortenmorup.dk.