Tillarom: an AJAX based folk song search and retrieval system with gesture interface based on kodály hand

  • Authors:
  • Attila Licsár;Tamás Szirányi;László Kovács;Balázs Pataki

  • Affiliations:
  • University of Pannonia, Egyetem, Hungary;University of Pannonia, Egyetem, Hungary;MTA SZTAKI, Computer and Automation Research Institute of the Hungarian Academy of Sciences, Budapest, Hungary;MTA SZTAKI, Computer and Automation Research Institute of the Hungarian Academy of Sciences, Budapest, Hungary

  • Venue:
  • Proceedings of the 1st ACM international workshop on Human-centered multimedia
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

A digital folk song search and retrieval system with a hand gesture based interface is presented. Tillarom is a comprehensive collection of original Hungarian folk songs recorded using different technologies such as phonographs and/or stereo DAT cassettes. This digital archive contains professional quality metadata records as well as MIDI recordings for presenting the different types of clustered folk songs. An AJAX based search and retrieval interface was developed that can be used together with optically recognized Kodály's hand signs to formulate queries through a web browser. The appearance based recognition of hand gestures utilizes contour analysis and SVM based classification. We evaluated the performance of the recognition of hand signs and investigated the main problems of their usage in our system.