User interface of a Home Page Reader
Assets '98 Proceedings of the third international ACM conference on Assistive technologies
Learning to classify text from labeled and unlabeled documents
AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
A vector space model for automatic indexing
Communications of the ACM
Machine Learning
Introduction to Algorithms
Proceedings of the 27th International Conference on Very Large Data Bases
Enhanced web document summarization using hyperlinks
Proceedings of the fourteenth ACM conference on Hypertext and hypermedia
Understanding Web query interfaces: best-effort parsing with hidden syntax
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Automatic extraction of web search interfaces for interface schema integration
Proceedings of the 13th international World Wide Web conference on Alternate track papers & posters
Automation and customization of rendered web pages
Proceedings of the 18th annual ACM symposium on User interface software and technology
WebInSight:: making web images accessible
Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
Csurf: a context-driven non-visual web-browser
Proceedings of the 16th international conference on World Wide Web
SADIe: Structural semantics for accessibility and device independence
ACM Transactions on Computer-Human Interaction (TOCHI)
Aibrowser for multimedia: introducing multimedia content accessibility for visually impaired users
Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
WebAnywhere: a screen reader on-the-go
W4A '08 Proceedings of the 2008 international cross-disciplinary conference on Web accessibility (W4A)
Introduction to Information Retrieval
Introduction to Information Retrieval
Web Accessibility: A Foundation for Research
Web Accessibility: A Foundation for Research
Learning to extract form labels
Proceedings of the VLDB Endowment
Hearsay: a new generation context-driven multi-modal assistive web browser
Proceedings of the 19th international conference on World wide web
Accessible skimming: faster screen reading of web pages
Proceedings of the 25th annual ACM symposium on User interface software and technology
Hi-index | 0.00 |
An important aspect of making the Web accessible to blind users is ensuring that all important web page elements such as links, clickable buttons, and form fields have explicitly assigned labels. Properly labeled content is then correctly read out by screen readers, a dominant assistive technology used by blind users. In particular, improperly labeled form fields can critically impede online transactions such as shopping, paying bills, etc. with screen readers. Very often labels are not associated with form fields or are missing altogether, making form filling a challenge for blind users. Algorithms for associating a form element with one of several candidate labels in its vicinity must cope with the variability of the element's features including label's location relative to the element, distance to the element, etc. Probabilistic models provide a natural machinery to reason with such uncertainties. In this paper we present a Finite Mixture Model (FMM) formulation of the label association problem. The variability of feature values are captured in the FMM by a mixture of random variables that are drawn from parameterized distributions. Then, the most likely label to be paired with a form element is computed by maximizing the log-likelihood of the feature data using the Expectation-Maximization algorithm. We also adapt the FMM approach for two related problems: assigning labels (from an external Knowledge Base) to form elements that have no candidate labels in their vicinity and for quickly identifying clickable elements such as add-to-cart, checkout, etc., used in online transactions even when these elements do not have textual captions (e.g., image buttons w/o alternative text). We provide a quantitative evaluation of our techniques, as well as a user study with two blind subjects who used an aural web browser implementing our approach.