Generating synopses for document-element search
Proceedings of the 18th ACM conference on Information and knowledge management
Interactive SIGHT into information graphics
Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)
Automated skimming in response to questions for nonvisual readers
SLPAT '10 Proceedings of the NAACL HLT 2010 Workshop on Speech and Language Processing for Assistive Technologies
Towards a framework for abstractive summarization of multimodal documents
HLT-SS '11 Proceedings of the ACL 2011 Student Session
Sight for visually impaired users: summarizing information graphics textually
Sight for visually impaired users: summarizing information graphics textually
A corpus of human-written summaries of line graphs
UCNLG+EVAL '11 Proceedings of the UCNLG+Eval: Language Generation and Evaluation Workshop
| Hi-index | 0.00 |
People without visual impairments often skim a document and look at the graphics it contains before deciding whether to read it in detail. While this is easy for sighted people, it is far more challenging for people with visual impairments, especially since the graphical content is largely inaccessible. We propose to increase the universal accessibility of articles in popular media containing both text and graphical elements for people with visual impairments by automatically generating an abstractive summary of the entire multimodal document. Our goal is to enable users to quickly access the high-level content of a multimodal document, and to decide whether to commit to reading the full article.