Person spotting: video shot retrieval for face sets

Authors:
Josef Sivic;Mark Everingham;Andrew Zisserman
Affiliations:
Department of Engineering Science, University of Oxford;Department of Engineering Science, University of Oxford;Department of Engineering Science, University of Oxford
Venue:
CIVR'05 Proceedings of the 4th international conference on Image and Video Retrieval
Year:
2005

Citing 14
Cited 42

Face Recognition by Elastic Bunch Graph Matching

IEEE Transactions on Pattern Analysis and Machine Intelligence
Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons

International Journal of Computer Vision
Name-It: Naming and Detecting Faces in News Videos

IEEE MultiMedia
Exemplar-Based Face Recognition from Video

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Face Recognition from Long-Term Observations

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
From Instance-level Constraints to Space-Level Constraints: Making the Most of Prior Knowledge in Data Clustering

ICML '02 Proceedings of the Nineteenth International Conference on Machine Learning
Video Google: A Text Retrieval Approach to Object Matching in Videos

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Face recognition: component-based versus global approaches

Computer Vision and Image Understanding - Special issue on Face recognition
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Pictorial Structures for Object Recognition

International Journal of Computer Vision
Face Recognition with Image Sets Using Manifold Density Divergence

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Content based indexing of images and video using face detection and recognition methods

ICASSP '01 Proceedings of the Acoustics, Speech, and Signal Processing, 2001. on IEEE International Conference - Volume 03
Joint manifold distance: a new approach to appearance based clustering

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
Face detection and tracking in a video by propagating detection probabilities

IEEE Transactions on Pattern Analysis and Machine Intelligence

Player identification in soccer videos

Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval
Computational studies of human motion: part 1, tracking and motion synthesis

Foundations and Trends® in Computer Graphics and Vision
Automatic detection of player's identity in soccer videos using faces and text cues

MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Video parsing based on head tracking and face recognition

Proceedings of the 6th ACM international conference on Image and video retrieval
Soccer players identification based on visual local features

Proceedings of the 6th ACM international conference on Image and video retrieval
Comparison of face matching techniques under pose variation

Proceedings of the 6th ACM international conference on Image and video retrieval
Content based video matching using spatiotemporal volumes

Computer Vision and Image Understanding
Object recognition and segmentation in videos by connecting heterogeneous visual features

Computer Vision and Image Understanding
Eye localization for face matching: is it always useful and under what conditions?

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
A pose-wise linear illumination manifold model for face recognition using video

Computer Vision and Image Understanding
User Verification by Combining Speech and Face Biometrics in Video

ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing, Part II
Taking the bite out of automated naming of characters in TV video

Image and Vision Computing
Eye localization in low and standard definition content with application to face matching

Computer Vision and Image Understanding
Automatic Database Creation and Object's Model Learning

Knowledge Acquisition: Approaches, Algorithms and Applications
Video Analytics in Urban Environments

AVSS '09 Proceedings of the 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance
Video Search by Impression Extracted from Social Annotation

WISE '09 Proceedings of the 10th International Conference on Web Information Systems Engineering
A Graph Based Approach to Speaker Retrieval in Talk Show Videos with Transcript-Based Supervision

PCM '09 Proceedings of the 10th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Character identification in feature-length films using global face-name matching

IEEE Transactions on Multimedia
An experimental study on content-based face annotation of photos

BTAS'09 Proceedings of the 3rd IEEE international conference on Biometrics: Theory, applications and systems
Interesting faces: A graph-based approach for finding people in news

Pattern Recognition
Thermal and reflectance based personal identification methodology under variable illumination

Pattern Recognition
A video-based door monitoring system using local appearance-based face models

Computer Vision and Image Understanding
Flea, do you remember me?

ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part I
Automatic detection and recognition of players in soccer videos

VISUAL'07 Proceedings of the 9th international conference on Advances in visual information systems
Face recognition in smart rooms

MLMI'07 Proceedings of the 4th international conference on Machine learning for multimodal interaction
An efficient method for face retrieval from large video datasets

Proceedings of the ACM International Conference on Image and Video Retrieval
Spatio-temporal tube kernel for actor retrieval

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Online learning from local features for video-based face recognition

Pattern Recognition
Person re-identification in TV series using robust face recognition and user feedback

Multimedia Tools and Applications
Semi-supervised cast indexing for feature-length films

MMM'07 Proceedings of the 13th international conference on Multimedia Modeling - Volume Part I
Face recognition from video using the generic shape-illumination manifold

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part IV
Automatic annotation of sport video content

CIARP'05 Proceedings of the 10th Iberoamerican Congress conference on Progress in Pattern Recognition, Image Analysis and Applications
Unfolding a face: from singular to manifold

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part III
Finding people frequently appearing in news

CIVR'06 Proceedings of the 5th international conference on Image and Video Retrieval
2D Articulated Human Pose Estimation and Retrieval in (Almost) Unconstrained Still Images

International Journal of Computer Vision
Video retrieval by mimicking poses

Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
Achieving robust face recognition from video by combining a weak photometric model and a learnt generic face invariant

Pattern Recognition
Face association across unconstrained video frames using conditional random fields

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VII
Online annotation of faces in personal videos by sequential learning

Multimedia Tools and Applications
Model probability in self-organising maps

IWANN'13 Proceedings of the 12th international conference on Artificial Neural Networks: advences in computational intelligence - Volume Part II
Memory recall based video search: Finding videos you have seen before based on your memory

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Detecting People Looking at Each Other in Videos

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

Matching people based on their imaged face is hard because of the well known problems of illumination, pose, size and expression variation. Indeed these variations can exceed those due to identity. Fortunately, videos of people have the happy benefit of containing multiple exemplars of each person in a form that can easily be associated automatically using straightforward visual tracking. We describe progress in harnessing these multiple exemplars in order to retrieve humans automatically in videos, given a query face in a shot. There are three areas of interest: (i) the matching of sets of exemplars provided by “tubes” of the spatial-temporal volume; (ii) the description of the face using a spatial orientation field; and, (iii) the structuring of the problem so that retrieval is immediate at run time. The result is a person retrieval system, able to retrieve a ranked list of shots containing a particular person in the manner of Google. The method has been implemented and tested on two feature length movies.