Snap and Translate Using Windows Phone

Authors:
Jun Du;Qiang Huo;Lei Sun;Jian Sun
Affiliations:
-;-;-;-
Venue:
ICDAR '11 Proceedings of the 2011 International Conference on Document Analysis and Recognition
Year:
2011

Citing 0
Cited 4

Automatically characterizing places with opportunistic crowdsensing using smartphones

Proceedings of the 2012 ACM Conference on Ubiquitous Computing
A discriminative linear regression approach to adaptation of multi-prototype based classifiers and its applications for Chinese OCR

Pattern Recognition
Autonomous place naming system using opportunistic crowdsensing and knowledge from crowdsourcing

Proceedings of the 12th international conference on Information processing in sensor networks
Understanding the coverage and scalability of place-centric crowdsensing

Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing

Quantified Score

Hi-index	0.02

Visualization

Abstract

We have developed a prototype of a mobile app called "Snap and Translate" on "Windows Phone 7". A person who is reading an English menu/sign and wants a Chinese translation of an English word or phrase or paragraph can use a Windows Phone to snap an image of the text, tap the word or swipe the phrase or circle the paragraph with a finger, and get a Chinese translation displayed on the screen of the phone. This is enabled by seamless integration of three Microsoft technologies: intelligent text extraction, OCR, and machine translation based on a client-plus-cloud architecture. The current prototype also supports Chinese OCR plus Chinese-to-English translation. In this paper, we highlight the UI design of the system and the corresponding user-intention guided text extraction approach to achieving a compelling user experience.