An integrated, conditional model of information extraction and coreference with application to citation matching

Authors:
Ben Wellner;Andrew McCallum;Fuchun Peng;Michael Hay
Affiliations:
University of Massachusetts Amherst, Amherst, MA;University of Massachusetts Amherst, Amherst, MA;University of Massachusetts Amherst, Amherst, MA;University of Massachusetts Amherst, Amherst, MA
Venue:
UAI '04 Proceedings of the 20th conference on Uncertainty in artificial intelligence
Year:
2004

Citing 12
Cited 46

Digital Libraries and Autonomous Citation Indexing

Computer
Correlation Clustering

FOCS '02 Proceedings of the 43rd Symposium on Foundations of Computer Science
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data

ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
Variational Approximations between Mean Field Theory and the Junction Tree Algorithm

UAI '00 Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence
A Mutually Beneficial Integration of Data Mining and Information Extraction

Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence
Table extraction using conditional random fields

Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Dynamic conditional random fields: factorized probabilistic models for labeling and segmenting sequence data

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Shallow parsing with conditional random fields

NAACL '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1
Named Entity Extraction using AdaBoost

COLING-02 proceedings of the 6th conference on Natural language learning - Volume 20
Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons

CONLL '03 Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - Volume 4
Discriminative probabilistic models for relational data

UAI'02 Proceedings of the Eighteenth conference on Uncertainty in artificial intelligence
Efficiently inducing features of conditional random fields

UAI'03 Proceedings of the Nineteenth conference on Uncertainty in Artificial Intelligence

SPIN: searching personal information networks

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Information Extraction: Distilling Structured Data from Unstructured Text

Queue - Social Computing
Bibliometric impact measures leveraging topic analysis

Proceedings of the 6th ACM/IEEE-CS joint conference on Digital libraries
Learning metadata from the evidence in an on-line citation matching scheme

Proceedings of the 6th ACM/IEEE-CS joint conference on Digital libraries
Information extraction from research papers using conditional random fields

Information Processing and Management: an International Journal
Simultaneous record detection and attribute labeling in web data extraction

Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining
Efficient topic-based unsupervised name disambiguation

Proceedings of the 7th ACM/IEEE-CS joint conference on Digital libraries
Record matching in digital library metadata

Communications of the ACM - Alternate reality gaming
Building structured web community portals: a top-down, compositional, and incremental approach

VLDB '07 Proceedings of the 33rd international conference on Very large data bases
An architecture for a collaborative bibliographic database

TAPIA '07 Proceedings of the 2007 conference on Diversity in computing
An unsupervised framework for extracting and normalizing product attributes from multiple web sites

Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Unsupervised deduplication using cross-field dependencies

Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining
MyCites: An Intelligent Information System for Maintaining Citations

SETN '08 Proceedings of the 5th Hellenic conference on Artificial Intelligence: Theories, Models and Applications
An unsupervised method for joint information extraction and feature mining across different Web sites

Data & Knowledge Engineering
A Generalized Joint Inference Approach for Citation Matching

AI '08 Proceedings of the 21st Australasian Joint Conference on Artificial Intelligence: Advances in Artificial Intelligence
Just Add Weights: Markov Logic for the Semantic Web

Uncertainty Reasoning for the Semantic Web I
Information Extraction

Foundations and Trends in Databases
Summarizing key concepts using citation sentences

BioNLP '06 Proceedings of the Workshop on Linking Natural Language Processing and Biology: Towards Deeper Biological Literature Analysis
Language ID in the context of harvesting language data off the web

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Solving the problem of cascading errors: approximate Bayesian inference for linguistic annotation pipelines

EMNLP '06 Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing
Learning with probabilistic features for improved pipeline models

EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Bi-directional Joint Inference for Entity Resolution and Segmentation Using Imperatively-Defined Factor Graphs

ECML PKDD '09 Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases: Part II
Constraint-based entity matching

AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 2
Joint inference in information extraction

AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 1
Creating relational data from unstructured and ungrammatical data sources

Journal of Artificial Intelligence Research
Applying NLP technologies to the collection and enrichment of language data on the Web to aid linguistic research

LaTeCH-SHELT&R '09 Proceedings of the EACL 2009 Workshop on Language Technology and Resources for Cultural Heritage, Social Sciences, Humanities, and Education
Semantic annotation of unstructured and ungrammatical text

IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
An integrated discriminative probabilistic approach to information extraction

Proceedings of the 18th ACM conference on Information and knowledge management
Summarizing key concepts using citation sentences

LNLBioNLP '06 Proceedings of the HLT-NAACL BioNLP Workshop on Linking Natural Language and Biology
Better k-best parsing

Parsing '05 Proceedings of the Ninth International Workshop on Parsing Technology
Piecewise training for structured prediction

Machine Learning
Bridging the Gap between Linked Data and the Semantic Desktop

ISWC '09 Proceedings of the 8th International Semantic Web Conference
Markov logic

Probabilistic inductive logic programming
Extracting medication information from discharge summaries

Louhi '10 Proceedings of the NAACL HLT 2010 Second Louhi Workshop on Text and Data Mining of Health Documents
Improving the quality of text understanding by delaying ambiguity resolution

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
Evidence-based information extraction for high accuracy citation and author name identification

Large Scale Semantic Access to Content (Text, Image, Video, and Sound)
Normalizing web product attributes and discovering domain ontology with minimal effort

Proceedings of the fourth ACM international conference on Web search and data mining
Parsing citations in biomedical articles using conditional random fields

Computers in Biology and Medicine
Large-scale cross-document coreference using distributed inference and hierarchical models

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
A language independent approach for named entity recognition in subject headings

TPDL'11 Proceedings of the 15th international conference on Theory and practice of digital libraries: research and advanced technology for digital libraries
Efficient name disambiguation for large-scale databases

PKDD'06 Proceedings of the 10th European conference on Principle and Practice of Knowledge Discovery in Databases
Extracting and summarizing hot item features across different auction web sites

PAKDD'06 Proceedings of the 10th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining
Mining information for instance unification

ISWC'06 Proceedings of the 5th international conference on The Semantic Web
Information theoretic approach to information extraction

FQAS'06 Proceedings of the 7th international conference on Flexible Query Answering Systems
Location-based reasoning about complex multi-agent behavior

Journal of Artificial Intelligence Research
Joint inference of entities, relations, and coreference

Proceedings of the 2013 workshop on Automated knowledge base construction

Quantified Score

Hi-index	0.00

Visualization

Abstract

Although information extraction and coreference resolution appear together in many applications, most current systems perform them as independent steps. This paper describes an approach to integrated inference for extraction and coreference based on conditionally-trained undirected graphical models. We discuss the advantages of conditional probability training, and of a coreference model structure based on graph partitioning. On a data set of research paper citations, we show significant reduction in error by using extraction uncertainty to improve coreference citation matching accuracy, and using coreference to improve the accuracy of the extracted fields.