Lessons from a failure: generating tailored smoking cessation letters

  • Authors:
  • Ehud Reiter;Roma Robertson;Liesl M. Osman

  • Affiliations:
  • Department of Computing Science, University of Aberdeen, Aberdeen, UK;Department of Computing Science, University of Aberdeen, Aberdeen, UK and Department of General Practice and Primary Care, University of Aberdeen, Aberdeen, UK;Department of Medicine and Therapeutics, University of Aberdeen, Aberdeen, UK

  • Venue:
  • Artificial Intelligence
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

STOP is a Natural Language Generation (NLG) system that generates short tailored smoking cessation letters, based on responses to a four-page smoking questionnaire. A clinical trial with 2553 smokers showed that STOP was not effective; that is, recipients of a non-tailored letter were as likely to stop smoking as recipients of a tailored letter. In this paper we describe the STOP system and clinical trial. Although it is rare for AI papers to present negative results, we believe that useful lessons can be learned from STOP. We also believe that the AI community as a whole could benefit from considering the issue of how, when, and why negative results should be reported; certainly a major difference between AI and more established fields such as medicine is that very few AI papers report negative results.