Principles of mixed-initiative user interfaces
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Fixing web sites with greasemonkey
Linux Journal
Automation and customization of rendered web pages
Proceedings of the 18th annual ACM symposium on User interface software and technology
Translating keyword commands into executable code
UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Smart bookmarks: automatic retroactive macro recording on the web
Proceedings of the 20th annual ACM symposium on User interface software and technology
Programming by a sample: rapidly creating web applications with d.mix
Proceedings of the 20th annual ACM symposium on User interface software and technology
Scenario-Based Requirements for Web Macro Tools
VLHCC '07 Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing
Marmite: Towards End-User Programming for the Web
VLHCC '07 Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing
Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering
Accessmonkey: enabling and sharing end user accessibility improvements
ACM SIGACCESS Accessibility and Computing - ASSETS 2007 doctoral consortium
CoScripter: automating & sharing how-to knowledge in the enterprise
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Usable artificial intelligence
CHI '08 Extended Abstracts on Human Factors in Computing Systems
Accommodating data heterogeneity in ULS systems
Proceedings of the 2nd international workshop on Ultra-large-scale software-intensive systems
Using topes to validate and reformat data in end-user programming tools
Proceedings of the 4th international workshop on End-user software engineering
Recovering from errors during programming by demonstration
Proceedings of the 13th international conference on Intelligent user interfaces
Transcendence: enabling a personal view of the deep web
Proceedings of the 13th international conference on Intelligent user interfaces
Correspondence validation method for GUI operations and scenarios by operation history analysis
Proceedings of the 13th international conference on Intelligent user interfaces
Using scenario-based requirements to direct research on web macro tools
Journal of Visual Languages and Computing
An application-independent system for visualizing user operation history
Proceedings of the 21st annual ACM symposium on User interface software and technology
Inky: a sloppy command line for the web with rich visual feedback
Proceedings of the 21st annual ACM symposium on User interface software and technology
Zoetrope: interacting with the ephemeral web
Proceedings of the 21st annual ACM symposium on User interface software and technology
Highlight: a system for creating and deploying mobile web applications
Proceedings of the 21st annual ACM symposium on User interface software and technology
Accessing the deep web: when good ideas go bad
Companion to the 23rd ACM SIGPLAN conference on Object-oriented programming systems languages and applications
PicNTell: a camcorder metaphor for screen recording
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Usuários podem escrever especificações de sistemas? Um estudo empírico com uma linguagem de script
Proceedings of the VIII Brazilian Symposium on Human Factors in Computing Systems
End-user programming of mashups with vegemite
Proceedings of the 14th international conference on Intelligent user interfaces
Proceedings of the 14th international conference on Intelligent user interfaces
Trailblazer: enabling blind users to blaze trails through the web
Proceedings of the 14th international conference on Intelligent user interfaces
Fixing the program my computer learned: barriers for end users, challenges for the machine
Proceedings of the 14th international conference on Intelligent user interfaces
Automated Software Engineering
Attaching UI enhancements to websites with end users
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Usable intelligent interactive systems: CHI 2009 special interest group meeting
CHI '09 Extended Abstracts on Human Factors in Computing Systems
Workshop on end user programming for the web
CHI '09 Extended Abstracts on Human Factors in Computing Systems
What Is End-User Software Engineering and Why Does It Matter?
IS-EUD '09 Proceedings of the 2nd International Symposium on End-User Development
Generating photo manipulation tutorials by demonstration
ACM SIGGRAPH 2009 papers
Mining web interactions to automatically create mash-ups
Proceedings of the 22nd annual ACM symposium on User interface software and technology
Interpreting written how-to instructions
IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Lowering the barriers to website testing with CoTester
Proceedings of the 15th international conference on Intelligent user interfaces
GUI testing using computer vision
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
useKit: a step towards the executable web 3.0
Proceedings of the 19th international conference on World wide web
No Code Required: Giving Users Tools to Transform the Web
No Code Required: Giving Users Tools to Transform the Web
Using traits of web macro scripts to predict reuse
Journal of Visual Languages and Computing
TrapperKeeper: the case for using virtualization to add type awareness to file systems
HotStorage'10 Proceedings of the 2nd USENIX conference on Hot topics in storage and file systems
Chronicle: capture, exploration, and playback of document workflow histories
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
A conversational interface to web automation
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Creating collections with automatic suggestions and example-based refinement
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Soylent: a word processor with a crowd inside
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
The state of the art in end-user software engineering
ACM Computing Surveys (CSUR)
How to serve soup: interleaving demonstration and assisted editing to support nonprogrammers
Proceedings of the 16th international conference on Intelligent user interfaces
Automated browsing in AJAX websites
Data & Knowledge Engineering
Content and hierarchy in pixel-based methods for reverse engineering interface structure
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ACM Transactions on Graphics (TOG)
Why-oriented end-user debugging of naive Bayes text classification
ACM Transactions on Interactive Intelligent Systems (TiiS)
Real-time crowd control of existing interfaces
Proceedings of the 24th annual ACM symposium on User interface software and technology
Rule-Based impact propagation for trace replay
ICCBR'11 Proceedings of the 19th international conference on Case-Based Reasoning Research and Development
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Proceedings of the 34th International Conference on Software Engineering
SnipMatch: using source code context to enhance snippet retrieval and parameterization
Proceedings of the 25th annual ACM symposium on User interface software and technology
End-User Software Engineering and Why it Matters
Journal of Organizational and End User Computing
SNIPR: complementing code search with code retargeting capabilities
Proceedings of the 2013 International Conference on Software Engineering
Pixel-based reverse engineering of graphical interfaces
Proceedings of the adjunct publication of the 26th annual ACM symposium on User interface software and technology
A web-centred approach to end-user software engineering
ACM Transactions on Software Engineering and Methodology (TOSEM) - Testing, debugging, and error handling, formal methods, lifecycle concerns, evolution and maintenance
Tasklets: enabling end user programming of web widgets
International Journal of Web Engineering and Technology
Form-Based Web Service Composition for Domain Experts
ACM Transactions on the Web (TWEB)
An approach for supporting distributed user interface orchestration over the Web
International Journal of Human-Computer Studies
Hi-index | 0.01 |
We present Koala, a system that enables users to capture, share, automate, and personalize business processes on the web. Koala is a collaborative programming-by-demonstration system that records, edits, and plays back user interactions as pseudo-natural language scripts that are both human- and machine-interpretable. Unlike previous programming by demonstration systems, Koala leverages sloppy programming that interprets pseudo-natural language instructions (as opposed to formal syntactic statements) in the context of a given web page's elements and actions. Koala scripts are automatically stored in the Koalescence wiki, where a community of users can share, run, and collaboratively develop their "how-to" knowledge. Koala also takes advantage of corporate and personal data stores to automatically generalize and instantiate user-specific data, so that scripts created by one user are automatically personalized for others. Our initial experiences suggest that Koala is surprisingly effective at interpreting instructions originally written for people.