Environmental sound recognition using time-frequency intersection patterns

  • Authors:
  • Xuan Guo;Yoshiyuki Toyoda;Huankang Li;Jie Huang;Shuxue Ding;Yong Liu

  • Affiliations:
  • Graduate School of Computer Science and Engineering, The University of Aizu, Aizu-Wakamatsu, Japan;Graduate School of Computer Science and Engineering, The University of Aizu, Aizu-Wakamatsu, Japan;Department of Computer Science and Engineering, Shanghai Jiaotong University, Shanghai, China;Graduate School of Computer Science and Engineering, The University of Aizu, Aizu-Wakamatsu, Japan;Graduate School of Computer Science and Engineering, The University of Aizu, Aizu-Wakamatsu, Japan;Graduate School of Computer Science and Engineering, The University of Aizu, Aizu-Wakamatsu, Japan

  • Venue:
  • Applied Computational Intelligence and Soft Computing - Special issue on Awareness Science and Engineering
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Environmental sound recognition is an important function of robots and intelligent computer systems. In this research, we use a multistage perceptron neural network system for environmental sound recognition. The input data is a combination of timevariance pattern of instantaneous powers and frequency-variance pattern with instantaneous spectrum at the power peak, referred to as a time-frequency intersection pattern. Spectra of many environmental sounds change more slowly than those of speech or voice, so the intersectional time-frequency pattern will preserve the major features of environmental sounds but with drastically reduced data requirements. Two experiments were conducted using an original database and an open database created by the RWCP project. The recognition rate for 20 kinds of environmental sounds was 92%. The recognition rate of the new method was about 12% higher than methods using only an instantaneous spectrum. The results are also comparable with HMM-based methods, although those methods need to treat the time variance of an input vector series with more complicated computations.