Publications

This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication


Year(s) from:  to 
Author:
Keywords (separated by spaces):

V. Ferrari, M. Marin, and A. Zisserman Pose Search: retrieving people using their pose

V. Ferrari, M. Marin, and A. Zisserman
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
Miami, June 2009

Abstract

We describe a method for retrieving shots containing a particular 2D human pose from unconstrained movie and TV videos. The method involves first localizing the spatial layout of the head, torso and limbs in individual frames using pictorial structures, and associating these through a shot by tracking. A feature vector describing the pose is then constructed from the pictorial structure. Shots can be retrieved either by querying on a single frame with the desired pose, or through a pose classifier trained from a set of pose examples. Our main contribution is an effective system for retrieving people based on their pose, and in particular we propose and investigate several pose descriptors which are person, clothing, background and lighting independent. As a second contribution, we improve the performance over existing methods for localizing upper body layout on unconstrained video. We compare the spatial layout pose retrieval to a baseline method where poses are retrieved using a HOG descriptor. Performance is assessed on five episodes of the TV series 'Buffy the Vampire Slayer', and pose retrieval is demonstrated also on three Hollywood movies.


Download in pdf format
@InProceedings{eth_biwi_00667,
  author = {V. Ferrari and M. Marin and and A. Zisserman},
  title = { V. Ferrari, M. Marin, and A. Zisserman Pose Search: retrieving people using their pose},
  booktitle = {Proceedings of IEEE Conference on Computer Vision and Pattern Recognition},
  year = {2009},
  month = {June},
  publisher = {IEEE},
  keywords = {2D human pose estimation; image retrieval; human-centric video processing}
}