Structure compilation: trading structure for features

  • Authors:
  • Percy Liang;Hal Daumé, III;Dan Klein

  • Affiliations:
  • University of California, Berkeley, CA;University of Utah, Salt Lake City, UT;University of California, Berkeley, CA

  • Venue:
  • Proceedings of the 25th international conference on Machine learning
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Structured models often achieve excellent performance but can be slow at test time. We investigate structure compilation, where we replace structure with features, which are often computationally simpler but unfortunately statistically more complex. We analyze this tradeoff theoretically and empirically on three natural language processing tasks. We also introduce a simple method to transfer predictive power from structure to features via unlabeled data, while incurring a minimal statistical penalty.