The travails of visually impaired web travellers
HYPERTEXT '00 Proceedings of the eleventh ACM on Hypertext and hypermedia
Barriers to use: usability and content accessibility on the Web's most popular sites
CUU '00 Proceedings on the 2000 conference on Universal Usability
Homepage Usability: 50 Websites Deconstructed
Homepage Usability: 50 Websites Deconstructed
Maximum Accessibility: Making Your Web Site More Usable for Everyone
Maximum Accessibility: Making Your Web Site More Usable for Everyone
Adaptive Techniques for Universal Access
User Modeling and User-Adapted Interaction
Measuring Web Application Quality with WebQEM
IEEE MultiMedia
Evaluating and Designing the Quality of Web Sites
IEEE MultiMedia
CHI '04 Extended Abstracts on Human Factors in Computing Systems
The use of guidelines to automatically verify Web accessibility
Universal Access in the Information Society
Comparing accessibility evaluation tools: a method for tool effectiveness
Universal Access in the Information Society
Accessibility of Internet websites through time
Assets '04 Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility
Accessibility designer: visualizing usability for the blind
Assets '04 Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proposing new metrics to evaluate web usability for the blind
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Tree-Map Visualization for Web Accessibility
COMPSAC '05 Proceedings of the 29th Annual International Computer Software and Applications Conference - Volume 01
Metric for web accessibility evaluation
Journal of the American Society for Information Science and Technology
Augmenting the mobility of profoundly blind web travellers
The New Review of Hypermedia and Multimedia - Special issue: Scholarly hypermedia
The relationship between accessibility and usability of websites
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Quantitative metrics for measuring web accessibility
W4A '07 Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A)
Experimental evaluation of usability and accessibility of heading elements
W4A '07 Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A)
User-tailored web accessibility evaluations
Proceedings of the eighteenth conference on Hypertext and hypermedia
SAMBA: a semi-automatic method for measuring barriers of accessibility
Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
Effects of sampling methods on web accessibility evaluations
Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
International Journal of Human-Computer Studies
The impact of accessibility assessment in macro scale universal usability studies of the web
W4A '08 Proceedings of the 2008 international cross-disciplinary conference on Web accessibility (W4A)
Beyond Conformance: The Role of Accessibility Evaluation Methods
WISE '08 Proceedings of the 2008 international workshops on Web Information Systems Engineering
Towards More Mature Web Maintenance Practices for Accessibility
WSE '07 Proceedings of the 2007 9th IEEE International Workshop on Web Site Evolution
Quantitative evaluation for web accessibility with respect to disabled groups
Proceedings of the 2009 International Cross-Disciplinary Conference on Web Accessibililty (W4A)
Metrics for accessibility on the Vamolà project
Proceedings of the 2009 International Cross-Disciplinary Conference on Web Accessibililty (W4A)
Is It Possible to Predict the Manual Web Accessibility Result Using the Automatic Result?
UAHCI '09 Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services
Enriching web information scent for blind users
Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility
Validity and reliability of web accessibility guidelines
Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility
Collaborative web accessibility improvement: challenges and possibilities
Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility
Accessibility metrics of web pages for blind end-users
ICWE'03 Proceedings of the 2003 international conference on Web engineering
The adaptive web
On the testability of WCAG 2.0 for beginners
Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)
Application of traditional software testing methodologies to web accessibility
Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)
Testability and validity of WCAG 2.0: the expertise effect
Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility
Interpreting results from large scale automatic evaluation of web accessibility
ICCHP'06 Proceedings of the 10th international conference on Computers Helping People with Special Needs
ACM SIGACCESS Accessibility and Computing
Understanding web accessibility and its drivers
Proceedings of the International Cross-Disciplinary Conference on Web Accessibility
Following the WCAG 2.0 techniques: experiences from designing a WCAG 2.0 checking tool
ICCHP'12 Proceedings of the 13th international conference on Computers Helping People with Special Needs - Volume Part I
Sirius: A heuristic-based framework for measuring web usability adapted to the type of website
Journal of Systems and Software
Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility
Understanding users in the wild
Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility
Evaluating accessibility-in-use
Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility
Accessible online content creation by end users
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An approach to improve the accessibility and usability of existing web system
Proceedings of the 31st ACM international conference on Design of communication
Coping tactics employed by visually disabled users on the web
International Journal of Human-Computer Studies
Supporting navigation accessibility requirements in web engineering methods
Journal of Web Engineering
Determinants of the Web accessibility of European banks
Information Processing and Management: an International Journal
Hi-index | 0.00 |
The fact that several web accessibility metrics exist may be evidence of a lack of a comparison framework that highlights how well they work and for what purposes they are appropriate. In this paper we aim at formulating such a framework, demonstrating that it is feasible, and showing the findings we obtained when we applied it to seven existing automatic accessibility metrics. The framework encompasses validity, reliability, sensitivity, adequacy and complexity of metrics in the context of four scenarios where the metrics can be used. The experimental demonstration of the viability of the framework is based on applying seven published metrics to more than 1500 web pages and then operationalizing the notions of validity-as-conformance, adequacy and complexity. Our findings lead us to conclude that the Web Accessibility Quantitative Metric, Page Measure and Web Accessibility Barrier are the metrics that achieve the highest levels of quality (out of the seven that we examined). Finally, since we did not analyse reliability, sensitivity and validity-in-use, this paper provides guidance to address them in what are new research avenues.