A novel framework for SVM-based image retrieval on large databases
Proceedings of the 13th annual ACM international conference on Multimedia
Recursive Aggregation of Estimators by the Mirror Descent Algorithm with Averaging
Problems of Information Transmission
An Equivalence between SILF-SVR and Ordinary Kriging
Neural Processing Letters
An online support vector machine for abnormal events detection
Signal Processing - Special section: Advances in signal processing-assisted cross-layer designs
Online Passive-Aggressive Algorithms
The Journal of Machine Learning Research
Step Size Adaptation in Reproducing Kernel Hilbert Space
The Journal of Machine Learning Research
Noise Tolerant Variants of the Perceptron Algorithm
The Journal of Machine Learning Research
MESO: Supporting Online Decision Making in Autonomic Computing Systems
IEEE Transactions on Knowledge and Data Engineering
Pegasos: Primal Estimated sub-GrAdient SOlver for SVM
Proceedings of the 24th international conference on Machine learning
Tracking the best hyperplane with a simple budget Perceptron
Machine Learning
A primal-dual perspective of online learning algorithms
Machine Learning
Incremental margin algorithm for large margin classifiers
Neurocomputing
EURASIP Journal on Advances in Signal Processing
The projectron: a bounded kernel-based Perceptron
Proceedings of the 25th international conference on Machine learning
Online Regression Competitive with Changing Predictors
ALT '07 Proceedings of the 18th international conference on Algorithmic Learning Theory
Online Manifold Regularization: A New Learning Setting and Empirical Study
ECML PKDD '08 Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases - Part I
Online-updating regularized kernel matrix factorization models for large-scale recommender systems
Proceedings of the 2008 ACM conference on Recommender systems
Kernel least mean square algorithm with constrained growth
Signal Processing
Learning rates of gradient descent algorithm for classification
Journal of Computational and Applied Mathematics
Debellor: A Data Mining Platform with Stream Architecture
Transactions on Rough Sets IX
Online learning by ellipsoid method
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Limited stochastic meta-descent for kernel-based online learning
Neural Computation
Prediction and change detection in sequential data for interactive applications
AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 2
AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 3
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Online prediction of time series data with kernels
IEEE Transactions on Signal Processing
Novel multiclass classifiers based on the minimization of the within-class variance
IEEE Transactions on Neural Networks
Tighter perceptron with improved dual use of cached data for model representation and validation
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
On-line independent support vector machines
Pattern Recognition
Online modeling based on support vector machine
CCDC'09 Proceedings of the 21st annual international conference on Chinese Control and Decision Conference
Adaptive constrained learning in reproducing Kernel Hilbert spaces: the robust beamforming case
IEEE Transactions on Signal Processing
Online learning in biometrics: a case study in face classifier update
BTAS'09 Proceedings of the 3rd IEEE international conference on Biometrics: Theory, applications and systems
Tracking a moving hypothesis for visual data with explicit switch detection
CISDA'09 Proceedings of the Second IEEE international conference on Computational intelligence for security and defense applications
Bounded Kernel-Based Online Learning
The Journal of Machine Learning Research
Online Learning with Samples Drawn from Non-identical Distributions
The Journal of Machine Learning Research
Biometric classifier update using online learning: A case study in near infrared face verification
Image and Vision Computing
IEEE Computational Intelligence Magazine
An online core vector machine with adaptive MEB adjustment
Pattern Recognition
A study of spam filtering using support vector machines
Artificial Intelligence Review
Space-carving Kernels for Accurate Rough Terrain Estimation
International Journal of Robotics Research
Active noise control based on kernel least-mean-square algorithm
Asilomar'09 Proceedings of the 43rd Asilomar conference on Signals, systems and computers
The complex Gaussian kernel LMS algorithm
ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part II
Example-dependent basis vector selection for kernel-based classifiers
ECML PKDD'10 Proceedings of the 2010 European conference on Machine learning and knowledge discovery in databases: Part III
The application of structured learning in natural language processing
Machine Translation
Online multiple kernel learning: algorithms and mistake bounds
ALT'10 Proceedings of the 21st international conference on Algorithmic learning theory
Error tolerance based support vector machine for regression
Neurocomputing
A decentralized approach for nonlinear prediction of time series data in sensor networks
EURASIP Journal on Wireless Communications and Networking - Special issue on theoretical and algorithmic foundations of wireless ad hoc and sensor networks
Optimization and learning for rough terrain legged locomotion
International Journal of Robotics Research
Visual tracking via online manifold regularization
ICIMCS '10 Proceedings of the Second International Conference on Internet Multimedia Computing and Service
Tree Decomposition for Large-Scale SVM Problems
The Journal of Machine Learning Research
Exploitation of Machine Learning Techniques in Modelling Phrase Movements for Machine Translation
The Journal of Machine Learning Research
A new kernel-based algorithm for online clustering
ICANN'05 Proceedings of the 15th international conference on Artificial neural networks: formal models and their applications - Volume Part II
Two one-pass algorithms for data stream classification using approximate MEBs
ICANNGA'11 Proceedings of the 10th international conference on Adaptive and natural computing algorithms - Volume Part II
Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining
Online SVR Training by Solving the Primal Optimization Problem
Journal of Signal Processing Systems
A kernel-based Perceptron with dynamic memory
Neural Networks
Online learning meets optimization in the dual
COLT'06 Proceedings of the 19th annual conference on Learning Theory
Tracking the best hyperplane with a simple budget perceptron
COLT'06 Proceedings of the 19th annual conference on Learning Theory
An online AUC formulation for binary classification
Pattern Recognition
Editors Choice Article: I2VM: Incremental import vector machines
Image and Vision Computing
Sequential change-point detection based on direct density-ratio estimation
Statistical Analysis and Data Mining
Inhibition in multiclass classification
Neural Computation
A kernel fused perceptron for the online classification of large-scale data
Proceedings of the 1st International Workshop on Big Data, Streams and Heterogeneous Source Mining: Algorithms, Systems, Programming Models and Applications
IScIDE'11 Proceedings of the Second Sino-foreign-interchange conference on Intelligent Science and Intelligent Data Engineering
BDUOL: double updating online learning on a fixed budget
ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I
Online Multiple Kernel Classification
Machine Learning
A sparse kernel algorithm for online time series data prediction
Expert Systems with Applications: An International Journal
Confidence Weighted Mean Reversion Strategy for Online Portfolio Selection
ACM Transactions on Knowledge Discovery from Data (TKDD)
On online high-dimensional spherical data clustering and feature selection
Engineering Applications of Artificial Intelligence
Fixed budget quantized kernel least-mean-square algorithm
Signal Processing
Online algorithm based on support vectors for orthogonal regression
Pattern Recognition Letters
An introduction to artificial prediction markets for classification
The Journal of Machine Learning Research
The Journal of Machine Learning Research
Kernel minimum error entropy algorithm
Neurocomputing
An information theoretic sparse kernel algorithm for online learning
Expert Systems with Applications: An International Journal
Hi-index | 35.69 |
Kernel-based algorithms such as support vector machines have achieved considerable success in various problems in batch setting, where all of the training data is available in advance. Support vector machines combine the so-called kernel trick with the large margin idea. There has been little use of these methods in an online setting suitable for real-time applications. In this paper, we consider online learning in a reproducing kernel Hilbert space. By considering classical stochastic gradient descent within a feature space and the use of some straightforward tricks, we develop simple and computationally efficient algorithms for a wide range of problems such as classification, regression, and novelty detection. In addition to allowing the exploitation of the kernel trick in an online setting, we examine the value of large margins for classification in the online setting with a drifting target. We derive worst-case loss bounds, and moreover, we show the convergence of the hypothesis to the minimizer of the regularized risk functional. We present some experimental results that support the theory as well as illustrating the power of the new algorithms for online novelty detection.