Tensor Decompositions and Applications

Authors:
Tamara G. Kolda;Brett W. Bader
Affiliations:
tgkolda@sandia.gov;bwbader@sandia.gov
Venue:
SIAM Review
Year:
2009

Citing 0
Cited 173

Incremental tensor analysis: Theory and applications

ACM Transactions on Knowledge Discovery from Data (TKDD)
Scenario Discovery Using Nonnegative Tensor Factorization

CIARP '08 Proceedings of the 13th Iberoamerican congress on Pattern Recognition: Progress in Pattern Recognition, Image Analysis and Applications
View Discovery in OLAP Databases through Statistical Combinatorial Optimization

SSDBM 2009 Proceedings of the 21st International Conference on Scientific and Statistical Database Management
Spectral Clustering in Social-Tagging Systems

WISE '09 Proceedings of the 10th International Conference on Web Information Systems Engineering
TripleRank: Ranking Semantic Web Data by Tensor Decomposition

ISWC '09 Proceedings of the 8th International Semantic Web Conference
Sequential unfolding SVD for tensors with applications in array signal processing

IEEE Transactions on Signal Processing
Synthesis and editing of personalized stylistic human motion

Proceedings of the 2010 ACM SIGGRAPH symposium on Interactive 3D Graphics and Games
MusicBox: personalized music recommendation based on cubic analysis of social tags

IEEE Transactions on Audio, Speech, and Language Processing
Non-negative multilinear principal component analysis of auditory temporal modulations for music genre classification

IEEE Transactions on Audio, Speech, and Language Processing
Approximation algorithms for tensor clustering

ALT'09 Proceedings of the 20th international conference on Algorithmic learning theory
Relative Margin Support Tensor Machines for gait and action recognition

Proceedings of the ACM International Conference on Image and Video Retrieval
Fast and accurate tensor approximation of a multivariate convolution with linear scaling in dimension

Journal of Computational and Applied Mathematics
An always convergent algorithm for the largest eigenvalue of an irreducible nonnegative tensor

Journal of Computational and Applied Mathematics
Recovering tensor data from incomplete measurement via compressive sampling

Asilomar'09 Proceedings of the 43rd Asilomar conference on Signals, systems and computers
Spatiotemporal imaging with partially separable functions: a matrix recovery approach

ISBI'10 Proceedings of the 2010 IEEE international conference on Biomedical imaging: from nano to Macro
From frequency to meaning: vector space models of semantics

Journal of Artificial Intelligence Research
Exploring dialect phonetic variation using PARAFAC

SIGMORPHON '10 Proceedings of the 11th Meeting of the ACL Special Interest Group on Computational Morphology and Phonology
FacetCube: a framework of incorporating prior knowledge into non-negative tensor factorization

CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Collaborative filtering in social tagging systems based on joint item-tag recommendations

CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Letters: Numerical optimization of a sum-of-rank-1 decomposition for n-dimensional order-p symmetric tensors

Neurocomputing
Medical decision making using vector space model

Proceedings of the 1st ACM International Health Informatics Symposium
Classification with sums of separable functions

ECML PKDD'10 Proceedings of the 2010 European conference on Machine learning and knowledge discovery in databases: Part I
Kernel-based learning from infinite dimensional 2-way tensors

ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part II
Non-negative tensor factorization applied to music genre classification

IEEE Transactions on Audio, Speech, and Language Processing
Tensor algebra and multidimensional harmonic retrieval in signal processing for MIMO radar

IEEE Transactions on Signal Processing
Tensor-based channel estimation and iterative refinements for two-way relaying with multiple antennas and spatial reuse

IEEE Transactions on Signal Processing
Factorizing three-way binary data with triadic formal concepts

KES'10 Proceedings of the 14th international conference on Knowledge-based and intelligent information and engineering systems: Part I
A non-negative tensor factorization model for selectional preference induction

Natural Language Engineering
Temporal Link Prediction Using Matrix and Tensor Factorizations

ACM Transactions on Knowledge Discovery from Data (TKDD)
5D motion subspaces for planar motions

ECCV'10 Proceedings of the 11th European conference on computer vision conference on Computer vision: Part III
Probabilistic latent tensor factorization

LVA/ICA'10 Proceedings of the 9th international conference on Latent variable analysis and signal separation
Low-order tensor decompositions for social tagging recommendation

Proceedings of the fourth ACM international conference on Web search and data mining
Fast high-dimensional approximation with sparse occupancy trees

Journal of Computational and Applied Mathematics
Distributional memory: A general framework for corpus-based semantics

Computational Linguistics
A survey of multilinear subspace learning for tensor data

Pattern Recognition
Krylov Subspace Methods for Linear Systems with Tensor Product Structure

SIAM Journal on Matrix Analysis and Applications
Hierarchical Singular Value Decomposition of Tensors

SIAM Journal on Matrix Analysis and Applications
Approximation of $2^d\times2^d$ Matrices Using Tensor Decomposition

SIAM Journal on Matrix Analysis and Applications
Nonnegative tensor factorization as an alternative Csiszar---Tusnady procedure: algorithms, convergence, probabilistic interpretations and novel probabilistic tensor latent variable analysis algorithms

Data Mining and Knowledge Discovery
An information-theoretic, vector-space-model approach to cross-language information retrieval*

Natural Language Engineering
Computing the polyadic decomposition of nonnegative third order tensors

Signal Processing
PARAFAC algorithms for large-scale problems

Neurocomputing
Extended HALS algorithm for nonnegative Tucker decomposition and its applications for multiway analysis and classification

Neurocomputing
Image representation using Laplacian regularized nonnegative tensor factorization

Pattern Recognition
Latent subject-centered modeling of collaborative tagging: An application in social search

ACM Transactions on Management Information Systems (TMIS)
Common component analysis for multiple covariance matrices

Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining
Composing and updating verb argument expectations: a distributional semantic model

CMCL '11 Proceedings of the 2nd Workshop on Cognitive Modeling and Computational Linguistics
Detection of crossing white matter fibers with high-order tensors and rank-k decompositions

IPMI'11 Proceedings of the 22nd international conference on Information processing in medical imaging
Classification of clinical gene-sample-time microarray expression data via tensor decomposition methods

CIBB'10 Proceedings of the 7th international conference on Computational intelligence methods for bioinformatics and biostatistics
Tensor factorization using auxiliary information

ECML PKDD'11 Proceedings of the 2011 European conference on Machine learning and knowledge discovery in databases - Volume Part II
Hybrid clustering of multi-view data via Tucker-2 model and its application

Scientometrics
SCENT: Scalable compressed monitoring of evolving multirelational social networks

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special section on ACM multimedia 2010 best paper candidates, and issue on social media
Uni-orthogonal nonnegative tucker decomposition for supervised image classification

ICIAP'11 Proceedings of the 16th international conference on Image analysis and processing: Part I
On multivariate polynomials in Bernstein-Bézier form and tensor algebra

Journal of Computational and Applied Mathematics
High dimensional model representation (HDMR) based folded vector decomposition

AICT'11 Proceedings of the 2nd international conference on Applied informatics and computing theory
Towards a new multiway array decomposition algorithm: elementwise multiway array high dimensional model representation (EMAHDMR)

AICT'11 Proceedings of the 2nd international conference on Applied informatics and computing theory
Array flattening based univariate high dimensional model representation (AFBUHDMR)

AICT'11 Proceedings of the 2nd international conference on Applied informatics and computing theory
Visualizing the evolution of social networks

EPIA'11 Proceedings of the 15th Portugese conference on Progress in artificial intelligence
Fast metadata-driven multiresolution tensor decomposition

Proceedings of the 20th ACM international conference on Information and knowledge management
Approximate tensor decomposition within a tensor-relational algebraic framework

Proceedings of the 20th ACM international conference on Information and knowledge management
Spectral analysis of a blogosphere

Proceedings of the 20th ACM international conference on Information and knowledge management
A new framework for co-clustering of gene expression data

PRIB'11 Proceedings of the 6th IAPR international conference on Pattern recognition in bioinformatics
On Uniqueness of the $n$th Order Tensor Decomposition into Rank-1 Terms with Linear Independence in One Mode

SIAM Journal on Matrix Analysis and Applications
Quasi-Newton Methods on Grassmannians and Multilinear Approximations of Tensors

SIAM Journal on Scientific Computing
Tensor-Structured Galerkin Approximation of Parametric and Stochastic Elliptic PDEs

SIAM Journal on Scientific Computing
Numerical Solution of the Hartree-Fock Equation in Multilevel Tensor-Structured Format

SIAM Journal on Scientific Computing
Best Low Multilinear Rank Approximation of Higher-Order Tensors, Based on the Riemannian Trust-Region Scheme

SIAM Journal on Matrix Analysis and Applications
Algebraic Wavelet Transform via Quantics Tensor Train Decomposition

SIAM Journal on Scientific Computing
Tensor-Train Decomposition

SIAM Journal on Scientific Computing
Multi-way space-time-wave-vector analysis for EEG source separation

Signal Processing
On the computational benefit of tensor separation for high-dimensional discrete convolutions

Multidimensional Systems and Signal Processing
On context-aware co-clustering with metadata support

Journal of Intelligent Information Systems
Incremental multi-linear discriminant analysis using canonical correlations for action recognition

Neurocomputing
Hybrid clustering of multiple information sources via HOSVD

ISNN'10 Proceedings of the 7th international conference on Advances in Neural Networks - Volume Part II
Algorithms for probabilistic latent tensor factorization

Signal Processing
K-clustered tensor approximation: A sparse multilinear model for real-time rendering

ACM Transactions on Graphics (TOG)
Factorizing three-way ordinal data using triadic formal concepts

FQAS'11 Proceedings of the 9th international conference on Flexible Query Answering Systems
Analysis and compression of six-dimensional gyrokinetic datasets using higher order singular value decomposition

Journal of Computational Physics
Tensor displays: compressive light field synthesis using multilayer displays with directional backlighting

ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Link prediction on evolving data using tensor factorization

PAKDD'11 Proceedings of the 15th international conference on New Frontiers in Applied Data Mining
Block component analysis, a new concept for blind source separation

LVA/ICA'12 Proceedings of the 10th international conference on Latent Variable Analysis and Signal Separation
Factorizing YAGO: scalable machine learning for linked data

Proceedings of the 21st international conference on World Wide Web
FaIMS: A fast algorithm for the inverse medium problem with multiple frequencies and multiple sources for the scalar Helmholtz equation

Journal of Computational Physics
A people-to-people recommendation system using tensor space models

Proceedings of the 27th Annual ACM Symposium on Applied Computing
Ensemble of tensor classifiers based on the higher-order singular value decomposition

HAIS'12 Proceedings of the 7th international conference on Hybrid Artificial Intelligent Systems - Volume Part II
Unsupervised upright orientation of man-made models

Graphical Models
2011 Special Issue: A kernel-based framework to tensorial data analysis

Neural Networks
Data Driven Surface Reflectance from Sparse and Irregular Samples

Computer Graphics Forum
Tag-aware recommender systems: a state-of-the-art survey

Journal of Computer Science and Technology - Special issue on Community Analysis and Information Recommendation
GigaTensor: scaling tensor analysis up by 100 times - algorithms and discoveries

Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
A New Truncation Strategy for the Higher-Order Singular Value Decomposition

SIAM Journal on Scientific Computing
The Alternating Linear Scheme for Tensor Optimization in the Tensor Train Format

SIAM Journal on Scientific Computing
Maximum Block Improvement and Polynomial Optimization

SIAM Journal on Optimization
Uni-mode and Partial Uniqueness Conditions for CANDECOMP/PARAFAC of Three-Way Arrays with Linearly Dependent Loadings

SIAM Journal on Matrix Analysis and Applications
Block Tensor Unfoldings

SIAM Journal on Matrix Analysis and Applications
Wedderburn Rank Reduction and Krylov Subspace Method for Tensor Approximation. Part 1: Tucker Case

SIAM Journal on Scientific Computing
Low-Rank Tensor Krylov Subspace Methods for Parametrized Linear Systems

SIAM Journal on Matrix Analysis and Applications
Perturbation Theory and Optimality Conditions for the Best Multilinear Rank Approximation of a Tensor

SIAM Journal on Matrix Analysis and Applications
Blind Separation of Exponential Polynomials and the Decomposition of a Tensor in Rank-$(L_r,L_r,1)$ Terms

SIAM Journal on Matrix Analysis and Applications
Tensor rank and strong quantum nondeterminism in multiparty communication

TAMC'12 Proceedings of the 9th Annual international conference on Theory and Applications of Models of Computation
Feature selection from high-order tensorial data via sparse decomposition

Pattern Recognition Letters
Higher rank Support Tensor Machines for visual recognition

Pattern Recognition
TFMAP: optimizing MAP for top-n context-aware recommendation

SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Learning to rank social update streams

SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Fast similarity computation in factorized tensors

SISAP'12 Proceedings of the 5th international conference on Similarity Search and Applications
Domain and function: a dual-space model of semantic relations and compositions

Journal of Artificial Intelligence Research
The multilinear normal distribution: Introduction and some basic properties

Journal of Multivariate Analysis
Utilizing common substructures to speedup tensor factorization for mining dynamic graphs

Proceedings of the 21st ACM international conference on Information and knowledge management
Maximum likelihood estimation for the tensor normal distribution: Algorithm, minimum sample size, and empirical bias and dispersion

Journal of Computational and Applied Mathematics
Twitter hyperlink recommendation with user-tweet-hyperlink three-way clustering

Proceedings of the 21st ACM international conference on Information and knowledge management
A unified view on deformable shape factorizations

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
Hypergraph spectra for semi-supervised feature selection

ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I
ParCube: sparse parallelizable tensor decompositions

ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I
Generalized N-dimensional independent component analysis and its application to multiple feature selection and fusion for image classification

Neurocomputing
Hybrid bilinear and trilinear models for exploratory analysis of three-way poisson counts

ICANN'12 Proceedings of the 22nd international conference on Artificial Neural Networks and Machine Learning - Volume Part II
Embedding of the extended euclidean distance into pattern recognition with higher-order singular value decomposition of prototype tensors

CISIM'12 Proceedings of the 11th IFIP TC 8 international conference on Computer Information Systems and Industrial Management
MultiAspectForensics: mining large heterogeneous networks using tensor

International Journal of Web Engineering and Technology
Topological features in 2D symmetric higher-order tensor fields

EuroVis'11 Proceedings of the 13th Eurographics / IEEE - VGTC conference on Visualization
On solving biquadratic optimization via semidefinite relaxation

Computational Optimization and Applications
Expanders, tropical semi-rings, and nuclear norms: oh my!

XRDS: Crossroads, The ACM Magazine for Students - Scientific Computing
Collaborative filtering by analyzing dynamic user interests modeled by taxonomy

ISWC'12 Proceedings of the 11th international conference on The Semantic Web - Volume Part I
Hypergraph spectra for unsupervised feature selection

SSPR'12/SPR'12 Proceedings of the 2012 Joint IAPR international conference on Structural, Syntactic, and Statistical Pattern Recognition
A unified adaptive co-identification framework for high-d expression data

PRIB'12 Proceedings of the 7th IAPR international conference on Pattern Recognition in Bioinformatics
Computing sparse representations of multidimensional signals using kronecker bases

Neural Computation
Building Tag-Aware Groups for Music High-Order Ranking and Topic Discovery

International Journal of Multimedia Data Engineering & Management
Logistic tensor regression for classification

IScIDE'12 Proceedings of the third Sino-foreign-interchange conference on Intelligent Science and Intelligent Data Engineering
Tensor-SIFT Based Earth Mover's Distance for Contour Tracking

Journal of Mathematical Imaging and Vision
A Tensor Factorization Approach to Generalization in Multi-agent Reinforcement Learning

WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 02
Multi-SVD based subspace estimation to improve angle estimation accuracy in bistatic MIMO radar

Signal Processing
Exploring generative models of tripartite graphs for recommendation in social media

Proceedings of the 4th International Workshop on Modeling Social Media
High order pLSA for indexing tagged images

Signal Processing
Tracking and analyzing TV content on the web through social and ontological knowledge

Proceedings of the 11th european conference on Interactive TV and video
Multi-Relational learning for recommendation of matches between semantic structures

KES'12 Proceedings of the 16th international conference on Knowledge Engineering, Machine Learning and Lattice Computing with Applications
Exploiting depth and intensity information for head pose estimation with random forests and tensor models

ACCV'12 Proceedings of the 11th international conference on Computer Vision - Volume 2
Network discovery via constrained tensor analysis of fMRI data

Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
Personalized recommendation via cross-domain triadic factorization

Proceedings of the 22nd international conference on World Wide Web
A semi-algebraic framework for approximate CP decompositions via simultaneous matrix diagonalizations (SECSI)

Signal Processing
Centrality and mode detection in dynamic contact graphs; a joint diagonalisation approach

Proceedings of the 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining
Global analytic solution of fully-observed variational Bayesian matrix factorization

The Journal of Machine Learning Research
Focus 3D: Compressive accommodation display

ACM Transactions on Graphics (TOG)
Multilinear Factorizations for Multi-Camera Rigid Structure from Motion Problems

International Journal of Computer Vision
Human gesture recognition on product manifolds

The Journal of Machine Learning Research
Classification approach based on non-negative least squares

Neurocomputing
Mixing and matching usage data: techniques for mining varied activity data sources

Proceedings of the 41st annual ACM SIGUCCS conference on User services
Discovering facts with boolean tensor tucker decomposition

Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
Efficient energy management and data recovery in sensor networks using latent variables based tensor factorization

Proceedings of the 16th ACM international conference on Modeling, analysis & simulation of wireless and mobile systems
Efficient penetration depth approximation using active learning

ACM Transactions on Graphics (TOG)
Low-n-rank tensor recovery based on multi-linear augmented Lagrange multiplier method

Neurocomputing
Social Link Prediction in Online Social Tagging Systems

ACM Transactions on Information Systems (TOIS)
Optimal calculation of tensor learning approaches

ISNN'13 Proceedings of the 10th international conference on Advances in Neural Networks - Volume Part I
A tensor factorization based least squares support tensor machine for classification

ISNN'13 Proceedings of the 10th international conference on Advances in Neural Networks - Volume Part I
Robust tensor clustering with non-greedy maximization

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Dimensionality reduction with generalized linear models

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Learning canonical correlations of paired tensor sets via tensor-to-vector projection

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Multi-dimensional causal discovery

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Guarantees of augmented trace norm models in tensor recovery

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
An equi-directional generalization of adaptive cross approximation for higher-order tensors

Applied Numerical Mathematics
Hybrid computer vision system for drivers' eye recognition and fatigue monitoring

Neurocomputing
Note(s): A note on the fourth cumulant of a finite mixture distribution

Journal of Multivariate Analysis
Integration of multi-feature fusion and dictionary learning for face recognition

Image and Vision Computing
Joint speaker and environment adaptation using TensorVoice for robust speech recognition

Speech Communication
Linked taxonomies to capture users' subjective assessments of items to facilitate accurate collaborative filtering

Artificial Intelligence
Temporal QoS-aware web service recommendation via non-negative tensor factorization

Proceedings of the 23rd international conference on World wide web
Low-rank separated representation surrogates of high-dimensional stochastic functions: Application in Bayesian inference

Journal of Computational Physics
Multifactor sparse feature extraction using Convolutive Nonnegative Tucker Decomposition

Neurocomputing
Algorithms for nonnegative matrix and tensor factorizations: a unified view based on block coordinate descent framework

Journal of Global Optimization
Analysis of quantum linear systems' response to multi-photon states

Automatica (Journal of IFAC)
Learning with tensors: a framework based on convex optimization and spectral regularization

Machine Learning
Low-rank approximation in the numerical modeling of the Farley-Buneman instability in ionospheric plasma

Journal of Computational Physics
Tensor completion via a multi-linear low-n-rank factorization model

Neurocomputing
A tensor-based distributed discovery of missing association rules on the cloud

Future Generation Computer Systems
Finding the limit of diverging components in three-way Candecomp/Parafac-A demonstration of its practical merits

Computational Statistics & Data Analysis
TAMRESH - tensor approximation multiresolution hierarchy for interactive volume visualization

EuroVis '13 Proceedings of the 15th Eurographics Conference on Visualization

Quantified Score

Hi-index	0.03

Visualization

Abstract

This survey provides an overview of higher-order tensor decompositions, their applications, and available software. A tensor is a multidimensional or $N$-way array. Decompositions of higher-order tensors (i.e., $N$-way arrays with $N \geq 3$) have applications in psycho-metrics, chemometrics, signal processing, numerical linear algebra, computer vision, numerical analysis, data mining, neuroscience, graph analysis, and elsewhere. Two particular tensor decompositions can be considered to be higher-order extensions of the matrix singular value decomposition: CANDECOMP/PARAFAC (CP) decomposes a tensor as a sum of rank-one tensors, and the Tucker decomposition is a higher-order form of principal component analysis. There are many other tensor decompositions, including INDSCAL, PARAFAC2, CANDELINC, DEDICOM, and PARATUCK2 as well as nonnegative variants of all of the above. The N-way Toolbox, Tensor Toolbox, and Multilinear Engine are examples of software packages for working with tensors.