Walking walking-in-place flying, in virtual environments
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
VRPN: a device-independent, network-transparent VR peripheral system
VRST '01 Proceedings of the ACM symposium on Virtual reality software and technology
EGVE '02 Proceedings of the workshop on Virtual environments 2002
ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume I - Volume I
Gesture Modeling and Recognition Using Finite State Machines
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
3D User Interfaces: Theory and Practice
3D User Interfaces: Theory and Practice
Proceedings of the 2011 international conference on Virtual and mixed reality: systems and applications - Volume Part II
FAAST: The Flexible Action and Articulated Skeleton Toolkit
VR '11 Proceedings of the 2011 IEEE Virtual Reality Conference
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Machine Recognition of Human Activities: A Survey
IEEE Transactions on Circuits and Systems for Video Technology
Introduction: Foreword to the special section on touching the 3rd dimension
Computers and Graphics
Hi-index | 0.00 |
We present the Flexible Action and Articulated Skeleton Toolkit (FAAST), a middleware software framework for integrating full-body interaction with virtual environments, video games, and other user interfaces. This toolkit provides a complete end-to-end solution that includes a graphical user interface for custom gesture creation, sensor configuration, skeletal tracking, action recognition, and a variety of output mechanisms to control third party applications, allowing virtually any PC application to be repurposed for gestural control even if it does not explicit support input from motion sensors. To facilitate intuitive and transparent gesture design, we define a syntax for representing human gestures using rule sets that correspond to the basic spatial and temporal components of an action. These individual rules form primitives that, although conceptually simple on their own, can be combined both simultaneously and in sequence to form sophisticated gestural interactions. In addition to presenting the system architecture and our approach for representing and designing gestural interactions, we also describe two case studies that evaluated the use of FAAST for controlling first-person video games and improving the accessibility of computing interfaces for individuals with motor impairments. Thus, this work represents an important step toward making gestural interaction more accessible for practitioners, researchers, and hobbyists alike.