Reducing excessive amounts of data: multiple web queries for generation of pun candidates

  • Authors:
  • Pawel Dybala;Michal Ptaszynski;Kohichi Sayama

  • Affiliations:
  • Otaru University of Commerce, Otaru, Japan;High-Tech Research Center, Intelligent Techniques Laboratory 6, Hokkai-Gakuen University, Sapporo, Japan;Department of Information and Management Science, Otaru University of Commerce, Otaru, Japan

  • Venue:
  • Advances in Artificial Intelligence
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Humor processing is still a less studied issue, both in NLP and AI. In this paper we contribute to this field. In our previous research we showed that adding a simple pun generator to a chatterbot can significantly improve its performance. The pun generator we used generated only puns based on words (not phrases). In this paper we introduce the next stage of the system's development-- an algorithm allowing generation of phrasal pun candidates. We show that by using only the Internet (without any handmade humor-oriented lexicons), it is possible to generate puns based on complex phrases. As the output list is often excessively long, we also propose a method for reducing the number of candidates by comparing two web-query-based rankings. The evaluation experiment showed that the system achieved an accuracy of 72.5% for finding proper candidates in general, and the reduction method allowed us to significantly shorten the candidates list. The parameters of the reduction algorithm are variable, so that the balance between the number of candidates and the quality of output can be manipulated according to needs.