How speech/text alignment benefits web-based learning

Authors:
Sheng-Wei Li;Hao-Tung Lin;Herng-Yow Chen
Affiliations:
National Chi-Nan University, Taiwan, R.O.C.;National Chi-Nan University, Taiwan, R.O.C.;National Chi-Nan University, Taiwan, R.O.C.
Venue:
Proceedings of the 13th annual ACM international conference on Multimedia
Year:
2005

Citing 2
Cited 0

Cross-media correlation: a case study of navigated hypermedia documents

Proceedings of the tenth ACM international conference on Multimedia
Human perception of jitter and media synchronization

IEEE Journal on Selected Areas in Communications

Quantified Score

Hi-index	0.00

Visualization

Abstract

This demonstration presents an integrated web-based synchronized scenario for many-to-one cross-media correlations between speech (an EFL, English as Foreign Language, lecture with free-style lecturing behaviors) and the corresponding textual content. The analysis/presentation of the temporal correlations enable the vivid web-based language learning through the interactive functions: browsing speech via content, word-by-word pointer guidance, synchronized scrolling/highlighting, and listening training mode. We regularly analyze and repackage the multimedia content of VoA (Voice of America) [1], ICRT (International Community Radio Taipei) [2], and Online Lectures in our University [3]. Through the subjective experiments, this repackaged synchronized speech/text content does facilitate the learning for EFL learners.