Hand pose estimation and hand shape classification using multi-layered randomized decision forests

  • Authors:

  • Cem Keskin;Furkan K$#305/ra$#231/;Yunus Emre Kara;Lale Akarun

  • Affiliations:

  • Computer Engineering Department, Bo$#287/azi$#231/i University, Istanbul, Turkey;Computer Engineering Department, Bo$#287/azi$#231/i University, Istanbul, Turkey;Computer Engineering Department, Bo$#287/azi$#231/i University, Istanbul, Turkey;Computer Engineering Department, Bo$#287/azi$#231/i University, Istanbul, Turkey

  • Venue:
  • ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Vision based articulated hand pose estimation and hand shape classification are challenging problems. This paper proposes novel algorithms to perform these tasks using depth sensors. In particular, we introduce a novel randomized decision forest (RDF) based hand shape classifier, and use it in a novel multi---layered RDF framework for articulated hand pose estimation. This classifier assigns the input depth pixels to hand shape classes, and directs them to the corresponding hand pose estimators trained specifically for that hand shape. We introduce two novel types of multi---layered RDFs: Global Expert Network (GEN) and Local Expert Network (LEN), which achieve significantly better hand pose estimates than a single---layered skeleton estimator and generalize better to previously unseen hand poses. The novel hand shape classifier is also shown to be accurate and fast. The methods run in real---time on the CPU, and can be ported to the GPU for further increase in speed.