Learning to predict from textual data

  • Authors:
  • Kira Radinsky;Sagie Davidovich

  • Affiliations:
  • Computer Science Department, Technion|Israel Institute of Technology, Haifa, Israel;Computer Science Department, Technion|Israel Institute of Technology, Haifa, Israel

  • Venue:
  • Journal of Artificial Intelligence Research
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Given a current news event, we tackle the problem of generating plausible predictions of future events it might cause. We present a new methodology for modeling and predicting such future news events using machine learning and data mining techniques. Our Pundit algorithm generalizes examples of causality pairs to infer a causality predictor. To obtain precisely labeled causality examples, we mine 150 years of news articles and apply semantic natural language modeling techniques to headlines containing certain predefined causality patterns. For generalization, the model uses a vast number of world knowledge ontologies. Empirical evaluation on real news articles shows that our Pundit algorithm performs as well as non-expert humans.