Matrix analysis
Learnability and the Vapnik-Chervonenkis dimension
Journal of the ACM (JACM)
Lower Bound Methods and Separation Results for On-Line Learning Models
Machine Learning - Computational learning theory
An introduction to computational learning theory
An introduction to computational learning theory
The nature of statistical learning theory
The nature of statistical learning theory
Geometric arguments yield better bounds for threshold circuits and distributed computing
Theoretical Computer Science
An introduction to support Vector Machines: and other kernel-based learning methods
An introduction to support Vector Machines: and other kernel-based learning methods
Limitations of Learning via Embeddings in Euclidean Half-Spaces
COLT '01/EuroCOLT '01 Proceedings of the 14th Annual Conference on Computational Learning Theory and and 5th European Conference on Computational Learning Theory
A Linear Lower Bound on the Unbounded Error Probabilistic Communication Complexity
CCC '01 Proceedings of the 16th Annual Conference on Computational Complexity
ALT '02 Proceedings of the 13th International Conference on Algorithmic Learning Theory
On the limitations of embedding methods
COLT'05 Proceedings of the 18th annual conference on Learning Theory
COLT'05 Proceedings of the 18th annual conference on Learning Theory
Hi-index | 0.00 |
Concept classes can canonically be represented by matrices with entries 1 and -1. We use the singular value decomposition of this matrix to determine the optimal margins of embeddings of the concept classes of singletons and of half intervals in homogeneous Euclidean half spaces. For these concept classes the singular value decomposition can be used to construct optimal embeddings and also to prove the corresponding best possible upper bounds on the margin. We show that the optimal margin for embedding n singletons is n/3n-4 and that the optimal margin for half intervals over {1, . . . , n} is π/2ln n + Θ(1/(ln n)2). For the upper bounds on the margins we generalize a bound given in [6]. We also discuss the concept classes of monomials to point out limitations of our approach.