Access to multimodal articles for individuals with sight impairments

Authors:
Sandra Carberry;Stephanie Elzer Schwartz;Kathleen Mccoy;Seniz Demir;Peng Wu;Charles Greenbacker;Daniel Chester;Edward Schwartz;David Oliver;Priscilla Moraes
Affiliations:
University of Delaware;Millersville University;University of Delaware;Scientific and Technological Research Council of Turkey;University of Delaware;University of Delaware;University of Delaware;Carnegie Mellon University;Millersville University;University of Delaware
Venue:
ACM Transactions on Interactive Intelligent Systems (TiiS) - Special issue on highlights of the decade in interactive intelligent systems
Year:
2013

Citing 44
Cited 1

Attention, intentions, and the structure of discourse

Computational Linguistics
The visual display of quantitative information

The visual display of quantitative information
Audiograf: a diagram-reader for the blind

Assets '96 Proceedings of the second annual ACM conference on Assistive technologies
Computer graphics for the blind

ACM SIGCAPH Computers and the Physically Handicapped
The anatomy of a large-scale hypertextual Web search engine

WWW7 Proceedings of the seventh international conference on World Wide Web 7
Constructing sonified haptic line graphs for the blind student: first steps

Assets '00 Proceedings of the fourth international ACM conference on Assistive technologies
Passage retrieval based on language models

Proceedings of the eleventh international conference on Information and knowledge management
ICU-Talk, a communication aid for intubated intensive care patients

Proceedings of the fifth international ACM conference on Assistive technologies
On Building Intelligence into EagleEyes

Assistive Technology and Artificial Intelligence, Applications in Robotics, User Interfaces and Natural Language Processing
Comparing Two Haptic Interfaces for Multimodal Graph Rendering

HAPTICS '02 Proceedings of the 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems
Web-Based Haptic Applications for Blind People to Create Virtual Graphs

HAPTICS '03 Proceedings of the 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS'03)
ILEX: an architecture for a dynamic hypertext generation system

Natural Language Engineering
Autobrief: an experimental system for the automatic generation of briefings in integrated text and information graphics

International Journal of Human-Computer Studies
Exploring the use of structured musical stimuli to communicate simple diagrams: the role of context

International Journal of Human-Computer Studies
Living up to expectations: computing expert responses

HLT '86 Proceedings of the workshop on Strategic computing natural language
PLUMB: displaying graphs to the blind using an active auditory interface

Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility
Introduction to Data Mining, (First Edition)

Introduction to Data Mining, (First Edition)
A probabilistic framework for the recognition of intention in information graphics

A probabilistic framework for the recognition of intention in information graphics
A Model of Perceptual Task Effort for Bar Charts and its Role in Recognizing Intention

User Modeling and User-Adapted Interaction
Information graphics: an untapped resource for digital libraries

SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
SoundBar: exploiting multiple views in multimodal graph browsing

Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles
Information Visualization: Beyond the Horizon

Information Visualization: Beyond the Horizon
Exploring and exploiting the limited utility of captions in recognizing intention in information graphics

ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Improving accessibility to statistical graphs: the iGraph-Lite system

Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
Automated tactile graphics translation: in the field

Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
Unsupervised Graph-basedWord Sense Disambiguation Using Measures of Word Semantic Similarity

ICSC '07 Proceedings of the International Conference on Semantic Computing
Tactile chart generation tool

Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility
Exploiting Evidence Analysis in Plan Recognition

UM '07 Proceedings of the 11th international conference on User Modeling
Capturing the Evolution of Grammatical Knowledge in a CALL System for Deaf Learners of English

International Journal of Artificial Intelligence in Education
A review of overview+detail, zooming, and focus+context interfaces

ACM Computing Surveys (CSUR)
Statistical Language Models for Information Retrieval

Statistical Language Models for Information Retrieval
A cognitive model for understanding graphical perception

Human-Computer Interaction
User Interaction with Word Prediction: The Effects of Prediction Quality

ACM Transactions on Accessible Computing (TACCESS)
Making Microsoft Excel™: multimodal presentation of charts

Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility
A probabilistic framework for recognizing intention in information graphics

IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Generating textual summaries of bar charts

INLG '08 Proceedings of the Fifth International Natural Language Generation Conference
Using NLG and sensors to support personal narrative for children with complex communication needs

SLPAT '10 Proceedings of the NAACL HLT 2010 Workshop on Speech and Language Processing for Assistive Technologies
A discourse-aware graph-based content-selection framework

INLG '10 Proceedings of the 6th International Natural Language Generation Conference
Evaluating a tool for improving accessibility to charts and graphs

Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility
Usability of accessible bar charts

Diagrams'10 Proceedings of the 6th international conference on Diagrammatic representation and inference
Recognizing the intended message of line graphs

Diagrams'10 Proceedings of the 6th international conference on Diagrammatic representation and inference
Data Mining: Practical Machine Learning Tools and Techniques

Data Mining: Practical Machine Learning Tools and Techniques
Sight for visually impaired users: summarizing information graphics textually

Sight for visually impaired users: summarizing information graphics textually
Automatically recognizing intended messages in grouped bar charts

Diagrams'12 Proceedings of the 7th international conference on Diagrammatic Representation and Inference

Providing access to the high-level content of line graphs from online popular media

Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility

Quantified Score

Hi-index	0.00

Visualization

Abstract

Although intelligent interactive systems have been the focus of many research efforts, very few have addressed systems for individuals with disabilities. This article presents our methodology for an intelligent interactive system that provides individuals with sight impairments with access to the content of information graphics (such as bar charts and line graphs) in popular media. The article describes the methodology underlying the system's intelligent behavior, its interface for interacting with users, examples processed by the implemented system, and evaluation studies both of the methodology and the effectiveness of the overall system. This research advances universal access to electronic documents.