"Then click ok!": extracting references to interface elements in online documentation

Authors:
Adam Fourney;Ben Lafreniere;Richard Mann;Michael Terry
Affiliations:
University of Waterloo, Waterloo, Ontario, Canada;University of Waterloo, Waterloo, Ontario, Canada;University of Waterloo, Waterloo, Ontario, Canada;University of Waterloo, Waterloo, Ontario, Canada
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2012

Citing 9
Cited 1

Artificial Intelligence: A Modern Approach

Artificial Intelligence: A Modern Approach
Translating keyword commands into executable code

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Incorporating non-local information into information extraction systems by Gibbs sampling

ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Text Extraction from the Web via Text-to-Tag Ratio

DEXA '08 Proceedings of the 2008 19th International Conference on Database and Expert Systems Application
Interpreting written how-to instructions

IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
ShowMeHow: translating user interface instructions between applications

Proceedings of the 24th annual ACM symposium on User interface software and technology
Searching for software learning resources using application context

Proceedings of the 24th annual ACM symposium on User interface software and technology
Query-feature graphs: bridging user vocabulary and system functionality

Proceedings of the 24th annual ACM symposium on User interface software and technology
The zero-frequency problem: estimating the probabilities of novel events in adaptive text compression

IEEE Transactions on Information Theory

Tutorial-based interfaces for cloud-enabled applications

Proceedings of the 25th annual ACM symposium on User interface software and technology

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper presents a recognizer for identifying references to user interface components in online documentation. The recognizer first extracts phrases matching a list of known components, then employs a classifier to reject coincidental matches. We describe why this seemingly straightforward problem is challenging, then show how informal conventions in documentation writing can be leveraged to perform classification. Using the features identified in this paper, our approach achieves an average F1 score of 0.81, and can correctly distinguish between actual command references and coincidental matches in 93.7% of test cases.