Communications of the ACM
Redundant noisy attributes, attribute errors, and linear-threshold learning using winnow
COLT '91 Proceedings of the fourth annual workshop on Computational learning theory
Robust trainability of single neurons
COLT '92 Proceedings of the fifth annual workshop on Computational learning theory
Efficient distribution-free learning of probabilistic concepts
Journal of Computer and System Sciences - Special issue: 31st IEEE conference on foundations of computer science, Oct. 22–24, 1990
Circuits of the mind
An introduction to computational learning theory
An introduction to computational learning theory
The nature of statistical learning theory
The nature of statistical learning theory
Additive versus exponentiated gradient updates for linear prediction
STOC '95 Proceedings of the twenty-seventh annual ACM symposium on Theory of computing
COLT' 98 Proceedings of the eleventh annual conference on Computational learning theory
Learning to resolve natural language ambiguities: a unified approach
AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
Machine Learning
Automatic Rule Acquisition for Spelling Correction
ICML '97 Proceedings of the Fourteenth International Conference on Machine Learning
Embedded machine learning systems for natural language processing: a general framework
Connectionist, Statistical, and Symbolic Approaches to Learning for Natural Language Processing
Part of speech tagging using a network of linear separators
COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 2
Unsupervised word sense disambiguation rivaling supervised methods
ACL '95 Proceedings of the 33rd annual meeting on Association for Computational Linguistics
ACL '94 Proceedings of the 32nd annual meeting on Association for Computational Linguistics
An empirical study of smoothing techniques for language modeling
ACL '96 Proceedings of the 34th annual meeting on Association for Computational Linguistics
A rule-based approach to prepositional phrase attachment disambiguation
COLING '94 Proceedings of the 15th conference on Computational linguistics - Volume 2
Handling sparse data by successive abstraction
COLING '96 Proceedings of the 16th conference on Computational linguistics - Volume 2
Estimation of Dependences Based on Empirical Data: Springer Series in Statistics (Springer Series in Statistics)
Learning to parse database queries using inductive logic programming
AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 2
Learning to resolve natural language ambiguities: a unified approach
AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
A Winnow-Based Approach to Context-Sensitive Spelling Correction
Machine Learning - Special issue on natural language learning
A neuroidal architecture for cognitive computation
Journal of the ACM (JACM)
Machine learning in automated text categorization
ACM Computing Surveys (CSUR)
Detecting Faces in Images: A Survey
IEEE Transactions on Pattern Analysis and Machine Intelligence
Mutual online concept learning for multiple agents
Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 1
Learning to recognize three-dimensional objects
Neural Computation
A Tale of Two Classifiers: SNoW vs. SVM in Visual Recognition
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Learning a Sparse Representation for Object Detection
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Learning to Recognize 3D Objects with SNoW
ECCV '00 Proceedings of the 6th European Conference on Computer Vision-Part I
Evidence that Incremental Delta-Bar-Delta Is an Attribute-Efficient Linear Learner
ECML '02 Proceedings of the 13th European Conference on Machine Learning
ECML '02 Proceedings of the 13th European Conference on Machine Learning
PKDD '02 Proceedings of the 6th European Conference on Principles of Data Mining and Knowledge Discovery
Coherent Concepts, Robust Learning
SOFSEM '99 Proceedings of the 26th Conference on Current Trends in Theory and Practice of Informatics on Theory and Practice of Informatics
Constraint Classification: A New Approach to Multiclass Classification
ALT '02 Proceedings of the 13th International Conference on Algorithmic Learning Theory
Classification Approach to Word Selection in Machine Translation
AMTA '02 Proceedings of the 5th Conference of the Association for Machine Translation in the Americas on Machine Translation: From Research to Real Users
Question classification using support vector machines
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Improving accuracy in word class tagging through the combination of machine learning systems
Computational Linguistics
A classification approach to word prediction
NAACL 2000 Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference
Part of speech tagging using a network of linear separators
COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 2
Applying system combination to base noun phrase identification
COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 2
Learning to Detect Objects in Images via a Sparse, Part-Based Representation
IEEE Transactions on Pattern Analysis and Machine Intelligence
Mining Online Deal Forums for Hot Deals
WI '04 Proceedings of the 2004 IEEE/WIC/ACM International Conference on Web Intelligence
Bimodal HCI-related affect recognition
Proceedings of the 6th international conference on Multimodal interfaces
Unsupervised named entity classification models and their ensembles
COLING '02 Proceedings of the 19th international conference on Computational linguistics - Volume 1
COLING '02 Proceedings of the 19th international conference on Computational linguistics - Volume 1
Probabilistic reasoning for entity & relation recognition
COLING '02 Proceedings of the 19th international conference on Computational linguistics - Volume 1
A SNoW based supertagger with application to NP chunking
ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1
An unsupervised approach to prepositional phrase attachment using contextually similar words
ACL '00 Proceedings of the 38th Annual Meeting on Association for Computational Linguistics
Learning in natural language: theory and algorithmic approaches
ConLL '00 Proceedings of the 2nd workshop on Learning language in logic and the 4th conference on Computational natural language learning - Volume 7
ConLL '00 Proceedings of the 2nd workshop on Learning language in logic and the 4th conference on Computational natural language learning - Volume 7
A comparison between supervised learning algorithms for word sense disambiguation
ConLL '00 Proceedings of the 2nd workshop on Learning language in logic and the 4th conference on Computational natural language learning - Volume 7
Using induced rules as complex features in memory-based language learning
ConLL '00 Proceedings of the 2nd workshop on Learning language in logic and the 4th conference on Computational natural language learning - Volume 7
Shallow parsing by inferencing with classifiers
ConLL '00 Proceedings of the 2nd workshop on Learning language in logic and the 4th conference on Computational natural language learning - Volume 7
Using co-occurrence statistics as an information source for partial parsing of Chinese
CLPW '00 Proceedings of the second workshop on Chinese language processing: held in conjunction with the 38th Annual Meeting of the Association for Computational Linguistics - Volume 12
An empirical study of the domain dependence of supervised word sense disambiguation systems
EMNLP '00 Proceedings of the 2000 Joint SIGDAT conference on Empirical methods in natural language processing and very large corpora: held in conjunction with the 38th Annual Meeting of the Association for Computational Linguistics - Volume 13
Exploring evidence for shallow parsing
ConLL '01 Proceedings of the 2001 workshop on Computational Natural Language Learning - Volume 7
Using the distribution of performance for studying statistical NLP systems and corpora
ELDS '01 Proceedings of the workshop on Evaluation for Language and Dialogue Systems - Volume 9
An incremental decision list learner
EMNLP '02 Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10
Augmented mixture models for lexical disambiguation
EMNLP '02 Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10
Distinguishing easy and hard instances
COLING-02 proceedings of the 6th conference on Natural language learning - Volume 20
Named entity learning and verification: expectation maximization in large corpora
COLING-02 proceedings of the 6th conference on Natural language learning - Volume 20
PhraseNet: towards context sensitive lexical semantics
CONLL '03 Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - Volume 4
Adaptive information extraction
ACM Computing Surveys (CSUR)
Learning question classifiers: the role of semantic information
Natural Language Engineering
Compiling boostexter rules into a finite-state transducer
ACLdemo '04 Proceedings of the ACL 2004 on Interactive poster and demonstration sessions
Weakly supervised named entity transliteration and discovery from multilingual comparable corpora
ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
Discriminative hidden Markov modeling with long state dependence using a kNN ensemble
COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Semantic role labeling via integer linear programming inference
COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Emotions from text: machine learning for text-based emotion prediction
HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Named entity transliteration and discovery from multilingual comparable corpora
HLT-NAACL '06 Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics
Knowledge representation and reasoning based on entity and relation propagation diagram/tree
Intelligent Data Analysis
A pipeline framework for dependency parsing
COLING-ACL '06 Proceedings of the COLING/ACL on Main conference poster sessions
The importance of syntactic parsing and inference in semantic role labeling
Computational Linguistics
A Cluster-Based Classification Approach to Semantic Role Labeling
IEA/AIE '08 Proceedings of the 21st international conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems: New Frontiers in Applied Artificial Intelligence
Identifying semitic roots: Machine learning with linguistic constraints
Computational Linguistics
Active sample selection for named entity transliteration
HLT-Short '08 Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers
Object Class Recognition Using SNoW with a Part Vocabulary
RSFDGrC '07 Proceedings of the 11th International Conference on Rough Sets, Fuzzy Sets, Data Mining and Granular Computing
A pipeline model for bottom-up dependency parsing
CoNLL-X '06 Proceedings of the Tenth Conference on Computational Natural Language Learning
Investigating automatic alignment methods for slide generation from academic papers
CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning
A supervised algorithm for verb disambiguation into VerbNet classes
COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
Transliteration as constrained optimization
EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Efficiency versus convergence of Boolean kernels for on-line learning algorithms
Journal of Artificial Intelligence Research
Global inference for sentence compression an integer linear programming approach
Journal of Artificial Intelligence Research
IJCAI'99 Proceedings of the 16th international joint conference on Artificial intelligence - Volume 2
Relational learning for NLP using linear threshold elements
IJCAI'99 Proceedings of the 16th international joint conference on Artificial intelligence - Volume 2
Relational learning via propositional algorithms: an information extraction case study
IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 2
The necessity of syntactic parsing for semantic role labeling
IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Web-scale N-gram models for lexical disambiguation
IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Discriminative training of clustering functions: theory and experiments with entity identification
CONLL '05 Proceedings of the Ninth Conference on Computational Natural Language Learning
Generalized inference with multiple semantic role labeling systems
CONLL '05 Proceedings of the Ninth Conference on Computational Natural Language Learning
Tense sense disambiguation: a new syntactic polysemy task
EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Generating confusion sets for context-sensitive error correction
EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Algorithm selection and model adaptation for ESL correction tasks
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
CICLing'05 Proceedings of the 6th international conference on Computational Linguistics and Intelligent Text Processing
CICLing'05 Proceedings of the 6th international conference on Computational Linguistics and Intelligent Text Processing
Semantic role labeling for portuguese --- a preliminary approach ---
PROPOR'12 Proceedings of the 10th international conference on Computational Processing of the Portuguese Language
Hi-index | 0.00 |
We analyze a few of the commonly used statistics based and machine learning algorithms for natural language disambiguation tasks and observe that they can be recast as learning linear separators in the feature space. Each of the methods makes a priori assumptions which it employs, given the data, when searching for its hypothesis. Nevertheless, as we show, it searches a space that is as rich as the space of all linear separators. We use this to build an argument for a data driven approach which merely searches for a good linear separator in the feature space, without further assumptions on the domain or a specific problem.We present such an approach - a sparse network of linear separators, utilizing the Winnow learning algorithm - and show how to use it in a variety of ambiguity resolution problems. The learning approach presented is attribute-efficient and, therefore, appropriate for domains having very large number of attributes.In particular, we present an extensive experimental comparison of our approach with other methods on several well studied lexical disambiguation tasks such as context-sensitive spelling correction, prepositional phrase attachment and part of speech tagging. In all cases we show that our approach either outperforms other methods tried for these tasks or performs comparably to the best.