A language model approach to keyphrase extraction

Authors:
Takashi Tomokiyo;Matthew Hurst
Affiliations:
Intelliseek, Inc., Pittsburgh, PA;Intelliseek, Inc., Pittsburgh, PA
Venue:
MWE '03 Proceedings of the ACL 2003 workshop on Multiword expressions: analysis, acquisition and treatment - Volume 18
Year:
2003

Citing 12
Cited 37

Word association norms, mutual information, and lexicography

Computational Linguistics
Self-organized language modeling for speech recognition

Readings in speech recognition
Elements of information theory

Elements of information theory
Generating and evaluating domain-oriented multi-word terms from texts

Information Processing and Management: an International Journal
Foundations of statistical natural language processing

Foundations of statistical natural language processing
Learning Algorithms for Keyphrase Extraction

Information Retrieval
Fast Algorithms for Mining Association Rules in Large Databases

VLDB '94 Proceedings of the 20th International Conference on Very Large Data Bases
Domain-Specific Keyphrase Extraction

IJCAI '99 Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence
Accurate methods for the statistics of surprise and coincidence

Computational Linguistics - Special issue on using large corpora: I
Retrieving collocations from text: Xtract

Computational Linguistics - Special issue on using large corpora: I
MARSYAS: a framework for audio analysis

Organised Sound
An empirical study of smoothing techniques for language modeling

ACL '96 Proceedings of the 34th annual meeting on Association for Computational Linguistics

Deriving marketing intelligence from online discussion

Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining
Finding nuggets in documents: A machine learning approach

Journal of the American Society for Information Science and Technology
The political blogosphere and the 2004 U.S. election: divided they blog

Proceedings of the 3rd international workshop on Link discovery
Temporal profiles of queries

ACM Transactions on Information Systems (TOIS)
Towards Automated Reputation and Brand Monitoring on the Web

WI '06 Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence
A bio-inspired application of natural language processing: A case study in extracting multiword expression

Expert Systems with Applications: An International Journal
Query by document

Proceedings of the Second ACM International Conference on Web Search and Data Mining
Using query logs and click data to create improved document descriptions

Proceedings of the 2009 workshop on Web Search Click Data
An Unsupervised Approach to Product Attribute Extraction

ECIR '09 Proceedings of the 31th European Conference on IR Research on Advances in Information Retrieval
Detecting multiple facets of an event using graph-based unsupervised methods

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
CollabRank: towards a collaborative approach to single-document keyphrase extraction

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
Single document keyphrase extraction using neighborhood knowledge

AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 2
The impact of document structure on keyphrase extraction

Proceedings of the 18th ACM conference on Information and knowledge management
Exploiting neighborhood knowledge for single document summarization and keyphrase extraction

ACM Transactions on Information Systems (TOIS)
Use of topicality and information measures to improve document representation for story link detection

ECIR'07 Proceedings of the 29th European conference on IR research
Keyphrase extraction in scientific publications

ICADL'07 Proceedings of the 10th international conference on Asian digital libraries: looking back 10 years and forging new frontiers
Ontology learning for search applications

OTM'07 Proceedings of the 2007 OTM Confederated international conference on On the move to meaningful internet systems: CoopIS, DOA, ODBASE, GADA, and IS - Volume Part I
Key phrase extraction: a hybrid assignment and extraction approach

Proceedings of the 11th International Conference on Information Integration and Web-based Applications & Services
GROBID: combining automatic bibliographic data recognition and term extraction for scholarship publications

ECDL'09 Proceedings of the 13th European conference on Research and advanced technology for digital libraries
DERIUNLP: A context based approach to automatic keyphrase extraction

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
UvT: The UvT term extraction system in the keyphrase extraction task

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
Citation summarization through keyphrase extraction

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
An approach to quantitatively measuring collaborative performance in online conversations

Computers in Human Behavior
Conundrums in unsupervised keyphrase extraction: making sense of the state-of-the-art

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Topical keyphrase extraction from Twitter

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Query by document via a decomposition-based two-level retrieval approach

Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
A Novel lecture browsing system using ranked key phrases and streamgraphs

TSD'11 Proceedings of the 14th international conference on Text, speech and dialogue
Emerging topic detection using dictionary learning

Proceedings of the 20th ACM international conference on Information and knowledge management
Unsupervised learning of multiword units from part-of-speech tagged corpora: does quantity mean quality?

EPIA'05 Proceedings of the 12th Portuguese conference on Progress in Artificial Intelligence
Creating a testbed for the evaluation of automatically generated back-of-the-book indexes

CICLing'06 Proceedings of the 7th international conference on Computational Linguistics and Intelligent Text Processing
Learning non-taxonomical semantic relations from domain texts

Journal of Intelligent Information Systems
Unsupervised keyphrase extraction for search ontologies

NLDB'06 Proceedings of the 11th international conference on Applications of Natural Language to Information Systems
Micropinion generation: an unsupervised approach to generating ultra-concise summaries of opinions

Proceedings of the 21st international conference on World Wide Web
Exploiting user comments for audio-visual content indexing and retrieval

ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval
A phrase mining framework for recursive construction of a topical hierarchy

Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
Lessons from the journey: a query log analysis of within-session learning

Proceedings of the 7th ACM international conference on Web search and data mining
Automatic keyphrase extraction from scientific articles

Language Resources and Evaluation

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a new approach to extracting keyphrases based on statistical language models. Our approach is to use pointwise KL-divergence between multiple language models for scoring both phraseness and informativeness, which can be unified into a single score to rank extracted phrases.