Modeling the language assessment process and result: proposed architecture for automatic oral proficiency assessment

Authors:
Gina-Anne Levow;Mari Broman Olsen
Affiliations:
University of Maryland Institute for Advanced Computer Studies, College Park, MD;University of Maryland Institute for Advanced Computer Studies, College Park, MD
Venue:
ASSESSEVALNLP '99 Proceedings of a Symposium on Computer Mediated Language Assessment and Evaluation in Natural Language Processing
Year:
1999

Citing 8
Cited 1

C4.5: programs for machine learning

C4.5: programs for machine learning
Machine translation: a view from the Lexicon

Machine translation: a view from the Lexicon
Interlingual machine translation: a parameterized approach

Artificial Intelligence - Special volume on natural language processing
A segmental approach to automatic language identification

A segmental approach to automatic language identification
Automatic Pronunciation Scoring for Language Instruction

ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97)-Volume 2 - Volume 2
Automated scoring using a hybrid feature identification technique

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
Inside-outside reestimation from partially bracketed corpora

ACL '92 Proceedings of the 30th annual meeting on Association for Computational Linguistics
Adaptive mixtures of local experts

Neural Computation

Applying discourse analysis and data mining methods to spoken OSCE assessments

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1

Quantified Score

Hi-index	0.00

Visualization

Abstract

We outline challenges for modeling human language assessment in automatic systems, both in terms of the process and the reliability of the result. We propose an architecture for a system to evaluate learners of Spanish via the Computerized Oral Proficiency Instrument, to determine whether they have 'reached' or 'not reached' the Intermediate Low level of proficiency, according to the American Council on the Teaching of Foreign Languages (ACTFL) Speaking Proficiency Guidelines. Our system divides the acoustic and non-acoustic features, incorporating human process modeling where permitted by the technology and required by the domain. We suggest machine learning techniques applied to this type of system permit insight into yet unarticulated aspects of the human rating process.