A probabilistic earley parser as a psycholinguistic model

Authors:
John Hale
Affiliations:
The Johns Hopkins University, Baltimore MD
Venue:
NAACL '01 Proceedings of the second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies
Year:
2001

Citing 7
Cited 30

An efficient probabilistic context-free parsing algorithm that computes prefix probabilities

Computational Linguistics
Probabilistic Languages: A Review and Some Open Questions

ACM Computing Surveys (CSUR)
An efficient context-free parsing algorithm

Communications of the ACM
Statistical Language Learning

Statistical Language Learning
Computation of the probability of initial substring generation by stochastic context-free grammars

Computational Linguistics
Prefix probabilities from stochastic Tree Adjoining Grammars

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 2
Exploiting syntactic structure for language modeling

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1

A finite-state model of human sentence processing

ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
Integrating syntactic priming into an incremental probabilistic parser, with an application to psycholinguistic modeling

ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
Surprising parser actions and reading difficulty

HLT-Short '08 Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers
An efficient algorithm to induce minimum average lookahead grammars for incremental LR parsing

IncrementParsing '04 Proceedings of the Workshop on Incremental Parsing: Bringing Engineering and Cognition Together
A noisy-channel model of rational human sentence comprehension under uncertain input

EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
A model of local coherence effects in human sentence processing as consequences of updates from bottom-up prior to posterior beliefs

NAACL '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics
The interaction of syntactic theory and computational psycholinguistics

ILCL '09 Proceedings of the EACL 2009 Workshop on the Interaction between Linguistics and Computational Linguistics: Virtuous, Vicious or Vacuous?
Deriving lexical and syntactic expectation-based measures for psycholinguistic modeling via incremental top-down parsing

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
Broad-coverage parsing using human-like memory constraints

Computational Linguistics
Syntactic and semantic factors in processing difficulty: an integrated measure

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
A rational model of eye movement control in reading

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
The influence of discourse on syntax a psycholinguistic model of sentence processing

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Complexity metrics in an incremental right-corner parser

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Cognitively plausible models of human language processing

ACLShort '10 Proceedings of the ACL 2010 Conference Short Papers
HHMM parsing with limited parallelism

CMCL '10 Proceedings of the 2010 Workshop on Cognitive Modeling and Computational Linguistics
The role of memory in superiority violation gradience

CMCL '10 Proceedings of the 2010 Workshop on Cognitive Modeling and Computational Linguistics
Modeling the noun phrase versus sentence coordination ambiguity in Dutch: evidence from surprisal theory

CMCL '10 Proceedings of the 2010 Workshop on Cognitive Modeling and Computational Linguistics
Uncertainty reduction as a measure of cognitive processing effort

CMCL '10 Proceedings of the 2010 Workshop on Cognitive Modeling and Computational Linguistics
Integrating surprisal and uncertain-input models in online sentence comprehension: formal techniques and empirical results

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Classification of atypical language in autism

CMCL '11 Proceedings of the 2nd Workshop on Cognitive Modeling and Computational Linguistics
A survival analysis of fixation times in reading

CMCL '11 Proceedings of the 2nd Workshop on Cognitive Modeling and Computational Linguistics
A model of discourse predictions in human sentence processing

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Exploring the lexical and acoustic consequences of referential predictability

DAARC'11 Proceedings of the 8th international conference on Anaphora Processing and Applications
Lexical surprisal as a general predictor of reading time

EACL '12 Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics
Connectionist-inspired incremental PCFG parsing

CMCL '12 Proceedings of the 3rd Workshop on Cognitive Modeling and Computational Linguistics
Sequential vs. hierarchical syntactic models of human incremental sentence processing

CMCL '12 Proceedings of the 3rd Workshop on Cognitive Modeling and Computational Linguistics
Syntactic surprisal affects spoken word duration in conversational contexts

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Measuring linguistically-induced cognitive load during driving using the ConTRe task

Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
Expectation-based sentence comprehension in Korean: evidence from behavioral and neurological studies

Proceedings of the 8th International Conference on Ubiquitous Information Management and Communication
Incremental, predictive parsing with psycholinguistically motivated tree-adjoining grammar

Computational Linguistics

Quantified Score

Hi-index	0.00

Visualization

Abstract

In human sentence processing, cognitive load can be defined many ways. This report considers a definition of cognitive load in terms of the total probability of structural options that have been disconfirmed at some point in a sentence: the surprisal of word wi given its prefix wo...i-1 on a phrase-structural language model. These loads can be efficiently calculated using a probabilistic Earley parser (Stolcke, 1995) which is interpreted as generating predictions about reading time on a word-by-word basis. Under grammatical assumptions supported by corpus-frequency data, the operation of Stolcke's probabilistic Earley parser correctly predicts processing phenomena associated with garden path structural ambiguity and with the subject/object relative asymmetry.