ON MEMORY LIMITATIONS IN NATURAL LANGUAGE PROCESSING

  • Authors:
  • K. W. Church

  • Affiliations:
  • -

  • Venue:
  • ON MEMORY LIMITATIONS IN NATURAL LANGUAGE PROCESSING
  • Year:
  • 1980

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper proposes a welcome hypothesis: a computationally simple device is sufficient for processing natural language. Traditionally it has been argued that processing natural language syntax requires very powerful machinery. Many engineers have come to this rather grim conclusion; almost all working parsers are actually Turing Machines (TM). For example, Woods specifically designed his Augmented Transition Networks (ATN''s) to be Turing Equivalent. If the problem is really as hard as it appears, then the only solution is to grin and bear it. Our own position is that parsing acceptable sentences is simpler because there are constraints on human performance that drastically reduce the computational requirements (time and space bounds). Although ideal linguistic competence is very complex, this observation may not apply directly to a real processing problem such as parsing. By including performance factors, it is possible to simplify the computation. We will propose two performance limitations, bounded memory and deterministic control, which have been incorporated in a new parser YAP.