A supervised clustering method for text classification

Authors:
Umarani Pappuswamy;Dumisizwe Bhembe;Pamela W. Jordan;Kurt VanLehn
Affiliations:
Learning Research and Development Center, University of Pittsburgh, Pittsburgh, PA;Learning Research and Development Center, University of Pittsburgh, Pittsburgh, PA;Learning Research and Development Center, University of Pittsburgh, Pittsburgh, PA;Learning Research and Development Center, University of Pittsburgh, Pittsburgh, PA
Venue:
CICLing'05 Proceedings of the 6th international conference on Computational Linguistics and Intelligent Text Processing
Year:
2005

Citing 8
Cited 0

Distributional clustering of words for text classification

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Automatic Indexing: An Experimental Inquiry

Journal of the ACM (JACM)
Machine learning in automated text categorization

ACM Computing Surveys (CSUR)
Unsupervised document classification using sequential information maximization

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Iterative Double Clustering for Unsupervised and Semi-supervised Learning

EMCL '01 Proceedings of the 12th European Conference on Machine Learning
The Architecture of Why2-Atlas: A Coach for Qualitative Physics Essay Writing

ITS '02 Proceedings of the 6th International Conference on Intelligent Tutoring Systems
Distributional clustering of English words

ACL '93 Proceedings of the 31st annual meeting on Association for Computational Linguistics
A hybrid text classification approach for analysis of student essays

HLT-NAACL-EDUC '03 Proceedings of the HLT-NAACL 03 workshop on Building educational applications using natural language processing - Volume 2

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes a supervised three-tier clustering method for classifying students' essays of qualitative physics in the Why2-Atlas tutoring system. Our main purpose of categorizing text in our tutoring system is to map the students' essay statements into principles and misconceptions of physics. A simple ‘bag-of-words' representation using a naïve-bayes algorithm to categorize text was unsatisfactory for our purposes of analyses as it exhibited many misclassifications because of the relatedness of the concepts themselves and its inability to handle misconceptions. Hence, we investigate the performance of the k-nearest neighborhood algorithm coupled with clusters of physics concepts on classifying students' essays. We use a three-tier tagging schemata (cluster, sub-cluster and class) for each document and found that this kind of supervised hierarchical clustering leads to a better understanding of the student's essay.