Conditional random fields for entity extraction and ontological text coding

  • Authors:
  • Jana Diesner;Kathleen M. Carley

  • Affiliations:
  • School of Computer Science, Institute for Software Research, Center for Computational Analysis of Social and Organizational Systems (CASOS), Carnegie Mellon University, Pittsburgh, USA 15213;School of Computer Science, Institute for Software Research, Center for Computational Analysis of Social and Organizational Systems (CASOS), Carnegie Mellon University, Pittsburgh, USA 15213

  • Venue:
  • Computational & Mathematical Organization Theory
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Previous research suggests that one field with a strong yet unsatisfied need for automatically extracting instances of various entity classes from texts is the analysis of socio-technical systems (Feldstein in Media in Transition MiT5, 2007; Hampe et al. in Netzwerkanalyse und Netzwerktheorie, 2007; Weil et al. in Proceedings of the 2006 Command and Control Research and Technology Symposium, 2006; Diesner and Carley in XXV Sunbelt Social Network Conference, 2005). Traditional as well as non-traditional and customized sets of entity classes and the relationships between them are often specified in ontologies or taxonomies. We present a Conditional Random Fields (CRF)-based approach to distilling a set of entities that are defined in an ontology originating from organization science. CRF, a supervised sequential machine learning technique, facilitates the derivation of relational data from corpora by locating and classifying instances of various entity classes. The classified entities can be used as nodes for the construction of socio-technical networks. We find the outcome sufficiently accurate (82.7 percent accuracy of locating and classifying entities) for future application in the described problem domain. We propose using the presented methodology as a crucial step in the process of advanced modeling and analysis of complex and dynamic networks.