Hierarchical document categorization with support vector machines

Authors:
Lijuan Cai;Thomas Hofmann
Affiliations:
Brown University, Providence, RI;Brown University, Providence, RI
Venue:
Proceedings of the thirteenth ACM international conference on Information and knowledge management
Year:
2004

Citing 18
Cited 80

Expert network: effective and efficient learning from human decisions in text categorization and retrieval

SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
The nature of statistical learning theory

The nature of statistical learning theory
Boosting and Rocchio applied to text filtering

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
A re-examination of text categorization methods

Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Hierarchical classification of Web content

SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
BoosTexter: A Boosting-based Systemfor Text Categorization

Machine Learning - Special issue on information retrieval
Text classification in a hierarchical mixture model for small training sets

Proceedings of the tenth international conference on Information and knowledge management
Exploiting Hierarchy in Text Categorization

Information Retrieval
Hierarchical Text Categorization Using Neural Networks

Information Retrieval
Naive (Bayes) at Forty: The Independence Assumption in Information Retrieval

ECML '98 Proceedings of the 10th European Conference on Machine Learning
Text Categorization with Suport Vector Machines: Learning with Many Relevant Features

ECML '98 Proceedings of the 10th European Conference on Machine Learning
Hierarchically Classifying Documents Using Very Few Words

ICML '97 Proceedings of the Fourteenth International Conference on Machine Learning
Improving Text Classification by Shrinkage in a Hierarchy of Classes

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Hierarchical Text Classification and Evaluation

ICDM '01 Proceedings of the 2001 IEEE International Conference on Data Mining
Building Hierarchical Classifiers Using Class Proximity

VLDB '99 Proceedings of the 25th International Conference on Very Large Data Bases
Using Taxonomy, Discriminants, and Signatures for Navigating in Text Databases

VLDB '97 Proceedings of the 23rd International Conference on Very Large Data Bases
On the algorithmic implementation of multiclass kernel-based vector machines

The Journal of Machine Learning Research
Support vector machine learning for interdependent and structured output spaces

ICML '04 Proceedings of the twenty-first international conference on Machine learning

Multi-labelled classification using maximum entropy method

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Support vector machines classification with a very large-scale taxonomy

ACM SIGKDD Explorations Newsletter - Natural language processing and text mining
Learning hierarchical multi-category text classification models

ICML '05 Proceedings of the 22nd international conference on Machine learning
Hierarchy-Regularized Latent Semantic Indexing

ICDM '05 Proceedings of the Fifth IEEE International Conference on Data Mining
Acclimatizing Taxonomic Semantics for Hierarchical Content Classification

Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining
Hierarchically SVM classification based on support vector clustering method and its application to document categorization

Expert Systems with Applications: An International Journal
Step Size Adaptation in Reproducing Kernel Hilbert Space

The Journal of Machine Learning Research
Kernel-Based Learning of Hierarchical Multilabel Classification Models

The Journal of Machine Learning Research
A scalable modular convex solver for regularized risk minimization

Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining
Training Classifiers for Tree-structured Categories with Partially Labeled Data

Journal of VLSI Signal Processing Systems
Reconstructing ddc for interactive classification

Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
Topic taxonomy adaptation for group profiling

ACM Transactions on Knowledge Discovery from Data (TKDD)
Deep classifier: automatically categorizing search results into large-scale hierarchies

WSDM '08 Proceedings of the 2008 International Conference on Web Search and Data Mining
Sensitive webpage classification for content advertising

Proceedings of the 1st international workshop on Data mining and audience intelligence for advertising
Boosting multi-label hierarchical text categorization

Information Retrieval
Predicting diverse subsets using structural SVMs

Proceedings of the 25th international conference on Machine learning
Deep classification in large-scale text hierarchies

Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Cross-Validation Optimization for Large Scale Structured Classification Kernel Methods

The Journal of Machine Learning Research
Multilabel classification via calibrated label ranking

Machine Learning
Error-driven generalist+experts (edge): a multi-stage ensemble framework for text categorization

Proceedings of the 17th ACM conference on Information and knowledge management
Semantic lattices for multiple annotation of images

MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
gBoost: a mathematical programming approach to graph classification and regression

Machine Learning
Large scale multi-label classification via metalabeler

Proceedings of the 18th international conference on World wide web
Web-scale classification with naive bayes

Proceedings of the 18th international conference on World wide web
Ml-rbf: RBF Neural Networks for Multi-Label Learning

Neural Processing Letters
Refined experts: improving classification in large taxonomies

Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Feature selection for multi-label naive Bayes classification

Information Sciences: an International Journal
Predicting structured objects with support vector machines

Communications of the ACM - Scratch Programming for All
Preferential text classification: learning algorithms and evaluation measures

Information Retrieval
Multi-label learning by instance differentiation

AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 1
Exploiting known taxonomies in learning overlapping concepts

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
A recent advance in the automatic indexing of the biomedical literature

Journal of Biomedical Informatics
Confusion and Distance Metrics as Performance Criteria for Hierarchical Classification Spaces

WI-IAT '09 Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Volume 02
An extensive study on automated Dewey Decimal Classification

Journal of the American Society for Information Science and Technology
Hierarchical multi-class text categorization with global margin maximization

ACLShort '09 Proceedings of the ACL-IJCNLP 2009 Conference Short Papers
Virtual cinematography director for interactive storytelling

Proceedings of the International Conference on Advances in Computer Enterntainment Technology
A structural support vector method for extracting contexts and answers of questions from online forums

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 2 - Volume 2
Automatic content-based categorization of Wikipedia articles

People's Web '09 Proceedings of the 2009 Workshop on The People's Web Meets NLP: Collaboratively Constructed Semantic Resources
Bundle Methods for Regularized Risk Minimization

The Journal of Machine Learning Research
Combining global and local information for enhanced deep classification

Proceedings of the 2010 ACM Symposium on Applied Computing
Hierarchical text categorization based on multiple feature selection and fusion of multiple classifiers approaches

FSKD'09 Proceedings of the 6th international conference on Fuzzy systems and knowledge discovery - Volume 1
A semi-dependent decomposition approach to learn hierarchical classifiers

Pattern Recognition
A Study of Hierarchical and Flat Classification of Proteins

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Hierarchical sequential learning for extracting opinions and their attributes

ACLShort '10 Proceedings of the ACL 2010 Conference Short Papers
Improving Hierarchical Classification with Partial Labels

Proceedings of the 2010 conference on ECAI 2010: 19th European Conference on Artificial Intelligence
Mr.KNN: soft relevance for multi-label classification

CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Hierarchical image feature extraction and classification

Proceedings of the international conference on Multimedia
Multi-label classification and extracting predicted class hierarchies

Pattern Recognition
Rule extraction from support vector machines: A review

Neurocomputing
The application of structured learning in natural language processing

Machine Translation
Incorporating the loss function into discriminative clustering of structured outputs

IEEE Transactions on Neural Networks
A survey of hierarchical classification across different application domains

Data Mining and Knowledge Discovery
Hierarchical classification with dynamic-threshold SVM ensemble for gene function prediction

ADMA'10 Proceedings of the 6th international conference on Advanced data mining and applications - Volume Part II
On exploiting hierarchical label structure with pairwise classifiers

ACM SIGKDD Explorations Newsletter
Text classification for a large-scale taxonomy using dynamically mixed local and global models for a node

ECIR'11 Proceedings of the 33rd European conference on Advances in information retrieval
Hierarchical text classification with latent concepts

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
A structural support vector method for extracting contexts and answers of questions from online forums

Information Processing and Management: an International Journal
Combining Bayesian Text Classification and Shrinkage to Automate Healthcare Coding: A Data Quality Analysis

Journal of Data and Information Quality (JDIQ)
Item categorization in the e-commerce domain

Proceedings of the 20th ACM international conference on Information and knowledge management
Multi-instance multi-label learning

Artificial Intelligence
Large Margin Hierarchical Classification with Mutually Exclusive Class Membership

The Journal of Machine Learning Research
Efficient classification of images with taxonomies

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part III
Draw your own story: paper and pencil interactive storytelling

ICEC'11 Proceedings of the 10th international conference on Entertainment Computing
An evaluation of classification models for question topic categorization

Journal of the American Society for Information Science and Technology
Multi-label hypothesis reuse

Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
On Taxonomies for Multi-class Image Categorization

International Journal of Computer Vision
A three-phase method for patent classification

Information Processing and Management: an International Journal
Hierarchical classification of web documents by stratified discriminant analysis

IRFC'12 Proceedings of the 5th conference on Multidisciplinary Information Retrieval
A cost sensitive part-of-speech tagging: differentiating serious errors from minor errors

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1
Large-scale item categorization for e-commerce

Proceedings of the 21st ACM international conference on Information and knowledge management
On active learning in hierarchical classification

Proceedings of the 21st ACM international conference on Information and knowledge management
Learning compact class codes for fast inference in large multi class classification

ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I
Adaptive classifier selection in large-scale hierarchical classification

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part III
Learning to rank from structures in hierarchical text classification

ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval
Recursive regularization for large-scale classification with hierarchical and graphical dependencies

Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
Cost-sensitive learning for large-scale hierarchical classification

Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
Community question topic categorization via hierarchical kernelized classification

Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
Classifying entities into an incomplete ontology

Proceedings of the 2013 workshop on Automated knowledge base construction
Learning by abstraction: Hierarchical classification model using evidential theoretic approach and Bayesian ensemble model

Neurocomputing
Utilizing global and path information with language modelling for hierarchical text classification

Journal of Information Science

Quantified Score

Hi-index	0.00

Visualization

Abstract

Automatically categorizing documents into pre-defined topic hierarchies or taxonomies is a crucial step in knowledge and content management. Standard machine learning techniques like Support Vector Machines and related large margin methods have been successfully applied for this task, albeit the fact that they ignore the inter-class relationships. In this paper, we propose a novel hierarchical classification method that generalizes Support Vector Machine learning and that is based on discriminant functions that are structured in a way that mirrors the class hierarchy. Our method can work with arbitrary, not necessarily singly connected taxonomies and can deal with task-specific loss functions. All parameters are learned jointly by optimizing a common objective function corresponding to a regularized upper bound on the empirical loss. We present experimental results on the WIPO-alpha patent collection to show the competitiveness of our approach.