Accessing a large multimodal corpus using an automatic content linking device

  • Authors:
  • Andrei Popescu-Belis;Jean Carletta;Jonathan Kilgour;Peter Poller

  • Affiliations:
  • Idiap Research Institute, Martigny, Switzerland;Human Communication Research Centre, University of Edinburgh, Edinburgh, Scotland, UK;Human Communication Research Centre, University of Edinburgh, Edinburgh, Scotland, UK;DFKI GmbH, Saarbruecken, Germany

  • Venue:
  • Multimodal corpora
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

As multimodal data becomes easier to record and store, the question arises as to what practical use can be made of archived corpora, and in particular what tools allowing efficient access to it can be built. We use the AMI Meeting Corpus as a case study to build an automatic content linking device, i.e. a system for real-time data retrieval. The corpus provides not only the data repository, but is used also to simulate ongoing meetings for development and testing of the device. The main features of the corpus are briefly described, followed by an outline of data preparation steps prior to indexing, and of the methods for building queries from ongoing meeting discussions, retrieving elements from the corpus and accessing the results. A series of user studies based on prototypes of the content linking device have confirmed the relevance of the concept, and methods for task-based evaluation are under development.