Travelmedia: An intelligent management system for media captured in travel
Journal of Visual Communication and Image Representation
A survey on question answering technology from an information retrieval perspective
Information Sciences: an International Journal
Facing scalability: Naming faces in an online social network
Pattern Recognition
Multimedia Tools and Applications
Cross-modal alignment for wildlife recognition
Proceedings of the 2nd ACM international workshop on Multimedia analysis for ecological data
Naming persons in video: Using the weak supervision of textual stories
Journal of Visual Communication and Image Representation
Automatic name-face alignment to enable cross-media news retrieval
IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Hi-index | 0.00 |
In this paper we report on our experiments on aligning names and faces as found in images and captions of online news Websites. Developing accurate technologies for linking names and faces is valuable when retrieving or mining information from multimedia collections. We perform exhaustive and systematic experiments exploiting the (a)symmetry between the visual and textual modalities. This leads to different schemes for assigning names to the faces, assigning faces to the names, and establishing name-face link pairs. On top of that, we investigate generic approaches to the use of textual and visual structural information to predict the presence of the corresponding entity in the other modality. The proposed methods are completely unsupervised and are inspired by methods for aligning phrases and words in texts of different languages developed for constructing dictionaries for machine translation. The results are competitive with state-of-the-art performance on the ??Labeled Faces in the Wild?? dataset in terms of recall values, now reported on the complete dataset, include excellent precision values, and show the value of text and image analysis for identifying the probability of being pictured or named in the alignment process.