The Story Picturing Engine---a system for automatic text illustration
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Toward communicating simple sentences using pictorial representations
Machine Translation
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Visual query suggestion: Towards capturing user intent in internet image search
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
News contextualization with geographic and visual information
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Global contrast based salient region detection
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Towards a Relevant and Diverse Search of Social Images
IEEE Transactions on Multimedia
Kinect-based visual communication system
Proceedings of the 4th International Conference on Internet Multimedia Computing and Service
| Hi-index | 0.00 |
Traditional instant messaging service mainly transfers textual message, while the visual message is ignored to a great extent. In this paper, we propose a novel instant messaging scheme with visual aids named Chat with Illustration (CWI), which presents users visual messages associated with chat content automatically. When users start their chat, the system first identifies meaningful keywords from dialogue content and analyzes context relations. Then CWI explores keyword-based image search in a image database with cluster-based index. Finally, according to context relations, CWI assembles these images properly and presents an optimal visual message for each dialogue sentence. With the combination of textual and visual message, users could enjoy a more interesting and vivid communication experience. Especially for different native language speakers, CWI can help them cross language barrier to some degree. The in-depth user studies demonstrate the effectiveness of our approach.