A prototype of landmark-based car navigation using a full-windshield head-up display system

Authors:
Wen Wu;Fabian Blaicher;Jie Yang;Thomas Seder;Dehua Cui
Affiliations:
Carnegie Mellon University, Pittsburgh, PA, USA;Carnegie Mellon University, Pittsburgh, PA, USA;Carnegie Mellon University, Pittsburgh, PA, USA;General Motors Company, Detroit, MI, USA;General Motors Company, Detroit, MI, USA
Venue:
AMC '09 Proceedings of the 2009 workshop on Ambient media computing
Year:
2009

Citing 5
Cited 1

Automatic text recognition for video indexing

MULTIMEDIA '96 Proceedings of the fourth ACM international conference on Multimedia
Comparison of head-up display (HUD) vs. head-down display (HDD): driving performance of commercial vehicle operators in Taiwan

International Journal of Human-Computer Studies
Object fingerprints for content analysis with applications to street landmark localization

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Detection of text on road signs from video

IEEE Transactions on Intelligent Transportation Systems
Automatic detection and recognition of signs from natural scenes

IEEE Transactions on Image Processing

Designing the car iWindow: exploring interaction through vehicle side windows

CHI '13 Extended Abstracts on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

In driving applications, a full windshield head-up display (FWD) system provides a flexible way for delivering driving related information. The projected information (text, image and graphics) is distorted on the car windshield because of its non-planar surface, the FWD projector's position and the viewing angle of the driver. In this paper, we present development of a prototype of landmark-based car navigation using an FWD system. We propose to use a computer vision method to automatically correct FWD projection distortion on the windshield. Our system consists of an FWD, a camera and an LCD video projector. In the calibration phase, the camera captures the patterns projected by the FWD projector and our method automatically models the windshield distortion. In the working phase, the LCD video projector projects a video sequence (that is captured on a moving vehicle in the real driving situation) onto a wall to simulate real driving and the camera simulates the driver's view. Our system aims to detect and highlight key landmarks such as road signs on the windshield by controlling the FWD projector to provide better navigation information. We demonstrate the proposed concept using our previously developed street landmark detection system.