Using Mobile Phones in Education
WMTE '04 Proceedings of the 2nd IEEE International Workshop on Wireless and Mobile Technologies in Education (WMTE'04)
Studying on the move: enriched presentation video for mobile devices
INFOCOM'09 Proceedings of the 28th IEEE international conference on Computer Communications Workshops
Improving and Aligning Speech with Presentation Slides
ICPR '10 Proceedings of the 2010 20th International Conference on Pattern Recognition
Client-side backprojection of presentation slides into educational video
Proceedings of the 20th ACM international conference on Multimedia
| Hi-index | 0.00 |
We present a system that assists users in viewing videos of lectures on small screen devices, such as cell phones. It automatically identifies semantic units on the slides, such as bullets, groups of bullets, and images. As the participant views the lecture, the system magnifies the appropriate semantic unit while it is the focus of the discussion. The system makes this decision based on cues from laser pointer gestures and spoken words that are read off the slide. It then magnifies the semantic element using the slide image and the homography between the slide image and the video frame. Experiments suggest that the semantic units of laser-based events identified by our algorithm closely match those identified by humans. In the case of identifying bullets through spoken words, results are more limited but are a good starting point for more complex methods. Finally, we show that this kind of magnification has potential for improving learning of technical content from video lectures when the resolution of the video is limited, such as when being viewed on hand held devices.