Extraction of field-coherent passages

Authors:
Samuel Sangkon Lee;Masami Shishibori;Toru Sumitomo;Jun-ichi Aoe
Affiliations:
Department of Information Science and Intelligent Systems, University of Tokushima, 2-1 Minami Josanjima, 770-8506 Tokushima, Japan;Department of Information Science and Intelligent Systems, University of Tokushima, 2-1 Minami Josanjima, 770-8506 Tokushima, Japan;Department of Information Science and Intelligent Systems, University of Tokushima, 2-1 Minami Josanjima, 770-8506 Tokushima, Japan;Department of Information Science and Intelligent Systems, University of Tokushima, 2-1 Minami Josanjima, 770-8506 Tokushima, Japan
Venue:
Information Processing and Management: an International Journal
Year:
2002

Citing 22
Cited 6

Approaches to passage retrieval in full text information systems

SIGIR '93 Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval
Subtopic structuring for full-length document access

SIGIR '93 Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval
Passage-level evidence in document retrieval

SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
Effective retrieval of structured documents

SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
Document and passage retrieval based on hidden Markov models

SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
Efficient retrieval of partial documents

TREC-2 Proceedings of the second conference on Text retrieval conference
Relevance feedback with too much data

SIGIR '95 Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval
Passage retrieval revisited

Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval
Information storage and retrieval

Information storage and retrieval
Passage retrieval: a probabilistic technique

Information Processing and Management: an International Journal
Locating passages using a case-base of excerpts

Proceedings of the seventh international conference on Information and knowledge management
Effective document presentation with a locality-based similarity heuristic

Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Managing gigabytes (2nd ed.): compressing and indexing documents and images

Managing gigabytes (2nd ed.): compressing and indexing documents and images
Efficient passage ranking for document databases

ACM Transactions on Information Systems (TOIS)
Passage-based query refinement (MultiText experiments for TREC-6)

Information Processing and Management: an International Journal - The sixth text REtrieval conference (TREC-6)
Finding relevant passages using noun-noun compounds (poster session): coherence vs. proximity

SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
A document classification method by using field association words

Information Sciences—Informatics and Computer Science: An International Journal
Efficient string matching: an aid to bibliographic search

Communications of the ACM
Passage feedback with IRIS

Information Processing and Management: an International Journal - Special issue on interactivity at the text retrieval conference (TREC)
Text Information Retrieval Systems

Text Information Retrieval Systems
Deduction over Mixed-Level Logic Representations for Text Passage Retrieval

ICTAI '96 Proceedings of the 8th International Conference on Tools with Artificial Intelligence
Lexical cohesion computed by thesaural relations as an indicator of the structure of text

Computational Linguistics

Improvement of building field association term dictionary using passage retrieval

Information Processing and Management: an International Journal
Ranking of field association terms using Co-word analysis

Information Processing and Management: an International Journal
Estimation of FAQ knowledge bases by using semantic expressions for questions and answers

International Journal of Computer Applications in Technology
Relevant estimation among fields using field association words

International Journal of Computer Applications in Technology
Building of field association terms based on links

International Journal of Computer Applications in Technology
Context constraint disambiguation of word semantics by field association schemes

Information Processing and Management: an International Journal

Quantified Score

Hi-index	0.01

Visualization

Abstract

It is important to identify text that is substantially independent of adjacent material. This paper presents a technique for dividing text into field-coherent passages. The method presented is based upon extracting field-associated words or phrases from the text by determining how topics grow, shrink and shift from sentence to sentence. We propose measures of topic continuity and transition and suggest how those may be used to find the passage boundaries. After collecting 12,500 documents, we obtained an average precision of 88% and recall of 78% in a training document set.