Practical color-based motion capture
SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Real-time classification of dance gestures from skeleton animation
SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
3D spatial interaction: applications for art, design, and science
ACM SIGGRAPH 2011 Courses
Communications of the ACM
Depth map enhancement using adaptive steering Kernel regression based on distance transform
ISVC'11 Proceedings of the 7th international conference on Advances in visual computing - Volume Part I
6D hands: markerless hand-tracking for computer aided design
Proceedings of the 24th annual ACM symposium on User interface software and technology
American sign language recognition with the kinect
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Robust hand gesture recognition based on finger-earth mover's distance with a commodity depth camera
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Human action recognition using multiple views: a comparative perspective on recent developments
J-HGBU '11 Proceedings of the 2011 joint ACM workshop on Human gesture and behavior understanding
Real-time head pose estimation using random regression forests
CCBR'11 Proceedings of the 6th Chinese conference on Biometric recognition
Pericles: a performance evaluation platform for indoor localization systems
Proceedings of the 3rd ACM SIGSPATIAL International Workshop on Indoor Spatial Awareness
Free viewpoint virtual try-on with commodity depth cameras
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
Continuous body and hand gesture recognition for natural human-computer interaction
ACM Transactions on Interactive Intelligent Systems (TiiS) - Special Issue on Affective Interaction in Natural Environments
Unsupervised clustering of people from 'skeleton' data
HRI '12 Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction
Part-based motion descriptor image for human action recognition
Pattern Recognition
On the use of depth camera for 3D phenotyping of entire plants
Computers and Electronics in Agriculture
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Studying user-defined iPad gestures for interaction in multi-display environment
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
International Journal of Computational Vision and Robotics
Foundations and Trends® in Computer Graphics and Vision
RGB-D based multi-attribute people search in intelligent visual surveillance
MMM'12 Proceedings of the 18th international conference on Advances in Multimedia Modeling
RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments
International Journal of Robotics Research
Human skeleton tracking from depth data using geodesic distances and optical flow
Image and Vision Computing
Instructing people for training gestural interactive systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
AffectAura: an intelligent system for emotional memory
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A review on vision techniques applied to Human Behaviour Analysis for Ambient-Assisted Living
Expert Systems with Applications: An International Journal
Mobile motion: multimodal device augmentation for musical applications
EVA'11 Proceedings of the 2011 international conference on Electronic Visualisation and the Arts
Videogame technology to support seniors
Proceedings of the 5th International ICST Conference on Simulation Tools and Techniques
Increasing kinect application development productivity by an enhanced hardware abstraction
Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems
Fast Human Pose Detection Using Randomized Hierarchical Cascades of Rejectors
International Journal of Computer Vision
The role of physical controllers in motion video gaming
Proceedings of the Designing Interactive Systems Conference
Co-evolutionary predictors for kinematic pose inference from RGBD images
Proceedings of the 14th annual conference on Genetic and evolutionary computation
Fitting distal limb segments for accurate skeletonization in human action recognition
Journal of Ambient Intelligence and Smart Environments
Depth information in human gait analysis: an experimental study on gender recognition
ICIAR'12 Proceedings of the 9th international conference on Image Analysis and Recognition - Volume Part II
A search-classify approach for cluttered indoor scene understanding
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Structure recovery by part assembly
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Accurate realtime full-body motion capture using a single depth camera
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Human activity recognition via the features of labeled depth body parts
ICOST'12 Proceedings of the 10th international smart homes and health telematics conference on Impact Ananlysis of Solutions for Chronic Disease Prevention and Management
Interactive environment-aware handheld projectors for pervasive computing spaces
Pervasive'12 Proceedings of the 10th international conference on Pervasive Computing
Fine-grained kitchen activity recognition using RGB-D
Proceedings of the 2012 ACM Conference on Ubiquitous Computing
Bimanual natural user interaction for 3D modelling application using stereo computer vision
Proceedings of the 13th International Conference of the NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction
3D puppetry: a kinect-based interface for 3D animation
Proceedings of the 25th annual ACM symposium on User interface software and technology
KinÊtre: animating the world with the human body
Proceedings of the 25th annual ACM symposium on User interface software and technology
3D object retrieval via range image queries based on SIFT descriptors on panoramic views
EG 3DOR'12 Proceedings of the 5th Eurographics conference on 3D Object Retrieval
Unsupervised human skeleton extraction from Kinect depth images
Proceedings of the 4th International Conference on Internet Multimedia Computing and Service
Proceedings of the 4th International Conference on Internet Multimedia Computing and Service
An interaction educational computer game framework using hand gesture recognition
Proceedings of the 4th International Conference on Internet Multimedia Computing and Service
Exploration and avoidance of surrounding obstacles for the visually impaired
Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility
Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility
Human posture recognition with a time-of-flight 3D sensor for in-home applications
Expert Systems with Applications: An International Journal
Joint activity theory as a framework for natural body expression in autonomous agents
Proceedings of the 1st International Workshop on Multimodal Learning Analytics
Emergency medicine training with gesture driven interactive 3D simulations
Proceedings of the 2012 ACM workshop on User experience in e-learning and augmented technologies in education
Recognizing actions using depth motion maps-based histograms of oriented gradients
Proceedings of the 20th ACM international conference on Multimedia
Model-based recognition of human actions by trajectory matching in phase spaces
Image and Vision Computing
Real-time dance pattern recognition invariant to anthropometric and temporal differences
ACIVS'12 Proceedings of the 14th international conference on Advanced Concepts for Intelligent Vision Systems
Learning to efficiently detect repeatable interest points in depth data
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Performance capture of interacting characters with handheld kinects
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Robust 3d action recognition with random occupancy patterns
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Patch based synthesis for single depth image super-resolution
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part III
Describing clothing by semantic attributes
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part III
Shapecollage: occlusion-aware, example-based shape interpretation
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part III
Learning to recognize unsuccessful activities using a two-layer latent structural model
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part III
Motion-aware structured light using spatio-temporal decodable patterns
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part V
Streaming hierarchical video segmentation
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
Real-time human pose tracking from range data
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
Hand pose estimation and hand shape classification using multi-layered randomized decision forests
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
Action recognition robust to background clutter by using stereo vision
ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part I
Re-identification with RGB-D sensors
ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part I
An introduction to random forests for multi-class object detection
Proceedings of the 15th international conference on Theoretical Foundations of Computer Vision: outdoor and large-scale real-world scene analysis
On performance analysis of optical flow algorithms
Proceedings of the 15th international conference on Theoretical Foundations of Computer Vision: outdoor and large-scale real-world scene analysis
Body pixel classification by neural network
ICIRA'12 Proceedings of the 5th international conference on Intelligent Robotics and Applications - Volume Part III
Recognizing materials from virtual examples
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
Joint classification-regression forests for spatially structured multi-object segmentation
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
INTAIRACT: joint hand gesture and fingertip classification for touchless interaction
ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part III
Human daily action analysis with multi-view and color-depth data
ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume 2
Edutainment'12/GameDays'12 Proceedings of the 7th international conference on Edutainment, and Proceedings of the 3rd international conference on E-Learning and Games for Training, Education, Health and Sports
Real-time annotation of video objects on tablet computers
Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia
OmniKinect: real-time dense volumetric data acquisition and applications
Proceedings of the 18th ACM symposium on Virtual reality software and technology
Fall detection based on skeleton extraction
Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
Assistive systems in production environments: exploring motion recognition and gamification
Proceedings of the 5th International Conference on PErvasive Technologies Related to Assistive Environments
Parallel gesture recognition with soft real-time guarantees
Proceedings of the 2nd edition on Programming systems, languages and applications based on actors, agents, and decentralized control abstractions
Can our TV robustly understand human gestures?: real-time gesture localization in range data
Proceedings of the 9th European Conference on Visual Media Production
Integrating approximate depth data into dense image correspondence estimation
Proceedings of the 9th European Conference on Visual Media Production
Physically interactive tabletop augmented reality using the Kinect
Proceedings of the 27th Conference on Image and Vision Computing New Zealand
Real-time hand pose estimation using classifiers
ICCVG'12 Proceedings of the 2012 international conference on Computer Vision and Graphics
Intelligent data analysis by a home-use human monitoring robot
IDA'12 Proceedings of the 11th international conference on Advances in Intelligent Data Analysis
Web-enhanced object category learning for domestic robots
Intelligent Service Robotics
Computer Vision and Image Understanding
A novel low-power embedded object recognition system working at multi-frames per second
ACM Transactions on Embedded Computing Systems (TECS) - Special section on ESTIMedia'12, LCTES'11, rigorous embedded systems design, and multiprocessor system-on-chip for cyber-physical systems
Real-Time markerless hand gesture recognition with depth camera
PCM'12 Proceedings of the 13th Pacific-Rim conference on Advances in Multimedia Information Processing
Using Segmented 3D Point Clouds for Accurate Likelihood Approximation in Human Pose Tracking
International Journal of Computer Vision
Exploring the Trade-off Between Accuracy and Observational Latency in Action Recognition
International Journal of Computer Vision
Random Forests for Real Time 3D Face Analysis
International Journal of Computer Vision
A Theory of Minimal 3D Point to 3D Plane Registration and Its Generalization
International Journal of Computer Vision
Direct Model-Based Tracking of 3D Object Deformations in Depth and Color Video
International Journal of Computer Vision
Position-invariant, real-time gesture recognition based on dynamic time warping
Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction
LMA based emotional motion representation using RGB-D camera
Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction
Real-time classification of dynamic hand gestures from marker-based position data
Proceedings of the companion publication of the 2013 international conference on Intelligent user interfaces companion
Multi-modal user identification and object recognition surveillance system
Pattern Recognition Letters
Fast anatomical structure localization using top-down image patch regression
MCV'12 Proceedings of the Second international conference on Medical Computer Vision: recognition techniques and applications in medical imaging
MCV'12 Proceedings of the Second international conference on Medical Computer Vision: recognition techniques and applications in medical imaging
3D motion estimation of human body from video with dynamic camera work
MPRSS'12 Proceedings of the First international conference on Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction
A system for practicing formations in dance performance supported by self-propelled screen
Proceedings of the 4th Augmented Human International Conference
Proceedings of the 12th international conference on Information processing in sensor networks
Human action recognition optimization based on evolutionary feature subset selection
Proceedings of the 15th annual conference on Genetic and evolutionary computation
Body-centric design space for multi-surface interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Online action recognition by template matching
HIS'13 Proceedings of the second international conference on Health Information Science
Body-tracking camera control for demonstration videos
CHI '13 Extended Abstracts on Human Factors in Computing Systems
HandSonor: a customizable vision-based control interface for musical expression
CHI '13 Extended Abstracts on Human Factors in Computing Systems
A robust stereo prior for human segmentation
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
Histogram of oriented normal vectors for object recognition with a depth sensor
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
Robust object tracking in crowd dynamic scenes using explicit stereo depth
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Robust fall detection by combining 3d data and fuzzy logic
ACCV'12 Proceedings of the 11th international conference on Computer Vision - Volume 2
ACCV'12 Proceedings of the 11th international conference on Computer Vision - Volume 2
Creature features: online motion puppetry for non-human characters
Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Operating system support for augmented reality applications
HotOS'13 Proceedings of the 14th USENIX conference on Hot Topics in Operating Systems
Model-based 3D tracking of an articulated hand from single depth images
Pattern Recognition Letters
Non-parametric hand pose estimation with object context
Image and Vision Computing
Probabilistic movement modeling for intention inference in human-robot interaction
International Journal of Robotics Research
Whole-home gesture recognition using wireless signals
Proceedings of the 19th annual international conference on Mobile computing & networking
Human nonverbal behavior multi-sourced ontological annotation
Proceedings of the International Workshop on Video and Image Ground Truth in Computer Vision Applications
ViziCal: accurate energy expenditure prediction for playing exergames
Proceedings of the 26th annual ACM symposium on User interface software and technology
Exploring discriminative pose sub-patterns for effective action classification
Proceedings of the 21st ACM international conference on Multimedia
Human activities recognition using depth images
Proceedings of the 21st ACM international conference on Multimedia
Online human gesture recognition from motion data streams
Proceedings of the 21st ACM international conference on Multimedia
Learning articulated body models for people re-identification
Proceedings of the 21st ACM international conference on Multimedia
A 3D tele-immersion streaming approach using skeleton-based prediction
Proceedings of the 21st ACM international conference on Multimedia
Human-virtual human interaction by upper body gesture understanding
Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology
Toward a 3D body part detection video dataset and hand tracking benchmark
Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments
Evaluating the accuracy of a mobile Kinect-based gait-monitoring system for fall prediction
Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments
Graph-based analysis of physical exercise actions
Proceedings of the 1st ACM international workshop on Multimedia indexing and information retrieval for healthcare
Analyzing growing plants from 4D point cloud data
ACM Transactions on Graphics (TOG)
ACM Transactions on Graphics (TOG)
On-set performance capture of multiple actors with a stereo camera
ACM Transactions on Graphics (TOG)
VisualComm: a tool to support communication between deaf and hearing persons with the Kinect
Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility
Multimodal analysis of body communication cues in employment interviews
Proceedings of the 15th ACM on International conference on multimodal interaction
IWANN'13 Proceedings of the 12th international conference on Artificial Neural Networks: advences in computational intelligence - Volume Part II
DHM'13 Proceedings of the 4th International conference on Digital Human Modeling and Applications in Health, Safety, Ergonomics, and Risk Management: healthcare and safety of the environment and transport - Volume Part I
Simultaneous localization and mapping for event-based vision systems
ICVS'13 Proceedings of the 9th international conference on Computer Vision Systems
Dimensionality reduction for efficient single frame hand pose estimation
ICVS'13 Proceedings of the 9th international conference on Computer Vision Systems
Situated multiparty interaction between humans and agents
HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: interaction modalities and techniques - Volume Part IV
Multi-party human-machine interaction using a smart multimodal digital signage
HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: interaction modalities and techniques - Volume Part IV
User interface of interactive media art in a stereoscopic environment
HCI'13 Proceedings of the 15th international conference on Human Interface and the Management of Information: information and interaction for learning, culture, collaboration and business - Volume Part III
Dynamics based 3D skeletal hand tracking
Proceedings of Graphics Interface 2013
Online RGB-D gesture recognition with extreme learning machines
Proceedings of the 15th ACM on International conference on multimodal interaction
Multi-modal gesture recognition challenge 2013: dataset and results
Proceedings of the 15th ACM on International conference on multimodal interaction
Multi-modal descriptors for multi-class hand pose recognition in human computer interaction systems
Proceedings of the 15th ACM on International conference on multimodal interaction
Ongoing human action recognition with motion capture
Pattern Recognition
Balance disorder rehabilitation through movement interaction
Proceedings of the 7th International Conference on Pervasive Computing Technologies for Healthcare
Web-based enrichment of bike sensor data for automatic geo-annotation
Proceedings of the Second ACM SIGSPATIAL International Workshop on Crowdsourced and Volunteered Geographic Information
Enabling fine-grained permissions for augmented reality applications with recognizers
SEC'13 Proceedings of the 22nd USENIX conference on Security
A real-time system for motion retrieval and interpretation
Pattern Recognition Letters
Silhouette-based human action recognition using sequences of key poses
Pattern Recognition Letters
Evolutionary joint selection to improve human action recognition with RGB-D devices
Expert Systems with Applications: An International Journal
IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Human action recognition using a temporal hierarchy of covariance descriptors on 3D joint locations
IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Principal direction analysis-based real-time 3D human pose reconstruction from a single depth image
Proceedings of the Fourth Symposium on Information and Communication Technology
Building facade detection, segmentation, and parameter estimation for mobile robot stereo vision
Image and Vision Computing
Automatic digital biometry analysis based on depth maps
Computers in Industry
People reidentification in surveillance and forensics: A survey
ACM Computing Surveys (CSUR)
Driver Pose Estimation Using a Mixture-model Method
Proceedings of the Second International Conference on Innovative Computing and Cloud Computing
Introducing the use of depth data for fall detection
Personal and Ubiquitous Computing
SimCrane 3D+: A crane simulator with kinesthetic and stereoscopic vision
Advanced Engineering Informatics
Detecting interaction above digital tabletops using a single depth camera
Machine Vision and Applications
Dynamic random regression forests for real-time head pose estimation
Machine Vision and Applications
Markerless human-robot interface for dual robot manipulators using Kinect sensor
Robotics and Computer-Integrated Manufacturing
Depth sensor assisted real-time gesture recognition for interactive presentation
Journal of Visual Communication and Image Representation
An adaptable system for RGB-D based human body detection and pose estimation
Journal of Visual Communication and Image Representation
Effective 3D action recognition using EigenJoints
Journal of Visual Communication and Image Representation
Pose-based human action recognition via sparse representation in dissimilarity space
Journal of Visual Communication and Image Representation
Keep it simple and sparse: real-time action recognition
The Journal of Machine Learning Research
A smart TV system with body-gesture control, tag-based rating and context-aware recommendation
Knowledge-Based Systems
Human activity recognition using multi-features and multiple kernel learning
Pattern Recognition
Online gesture recognition from pose kernel learning and decision forests
Pattern Recognition Letters
Real-time Hand Gesture Recognition from Depth Images Using Convex Shape Decomposition Method
Journal of Signal Processing Systems
3D object retrieval via range image queries in a bag-of-visual-words context
The Visual Computer: International Journal of Computer Graphics
Automatic objects segmentation with RGB-D cameras
Journal of Visual Communication and Image Representation
Recognizing object manipulation activities using depth and visual cues
Journal of Visual Communication and Image Representation
Human limb segmentation in depth maps based on spatio-temporal Graph-cuts optimization
Journal of Ambient Intelligence and Smart Environments
International Journal of Hybrid Intelligent Systems
Face Alignment by Explicit Shape Regression
International Journal of Computer Vision
| Hi-index | 0.02 |
We propose a new method to quickly and accurately predict 3D positions of body joints from a single depth image, using no temporal information. We take an object recognition approach, designing an intermediate body parts representation that maps the difficult pose estimation problem into a simpler per-pixel classification problem. Our large and highly varied training dataset allows the classifier to estimate body parts invariant to pose, body shape, clothing, etc. Finally we generate confidence-scored 3D proposals of several body joints by reprojecting the classification result and finding local modes. The system runs at 200 frames per second on consumer hardware. Our evaluation shows high accuracy on both synthetic and real test sets, and investigates the effect of several training parameters. We achieve state of the art accuracy in our comparison with related work and demonstrate improved generalization over exact whole-skeleton nearest neighbor matching.