An improved fusion and fission architecture between multi-modalities based on wearable computing

Authors:
Jung-Hyun Kim;Kwang-Seok Hong
Affiliations:
School of Information and Communication Engineering, Sungkyunkwan University, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, Korea;School of Information and Communication Engineering, Sungkyunkwan University, Chunchun-dong, Jangan-gu, Suwon, KyungKi-do, Korea
Venue:
UIC'07 Proceedings of the 4th international conference on Ubiquitous Intelligence and Computing
Year:
2007

Citing 5
Cited 0

Pattern classification: a unified view of statistical and neural approaches

Pattern classification: a unified view of statistical and neural approaches
Human Factors of Multi-modal Ubiquitous Computing

HUC '99 Proceedings of the 1st international symposium on Handheld and Ubiquitous Computing
The Invention of the First Wearable Computer

ISWC '98 Proceedings of the 2nd IEEE International Symposium on Wearable Computers
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Hand gesture recognition system using fuzzy algorithm and RDBMS for post PC

FSKD'05 Proceedings of the Second international conference on Fuzzy Systems and Knowledge Discovery - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper introduces improved fission rule depending on SNNR (Signal Plus Noise to Noise Ratio) and fuzzy value for simultaneous multimodality, and suggests the Fusion User Interface (hereinafter, FUI) including a synchronization between audio-gesture modalities, based on the embedded KSSL (Korean Standard Sign Language) recognizer using the WPS (Wearable Personal Station for the next generation PC) and Voice-XML. Our approach fuses and recognizes 65 sentential and 157 word language models that are represented by speech and KSSL, then translates the recognition result into synthetic speech and visual illustration (graphical display by HMD-Head Mounted Display) in real-time.