This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Finding Nemo: Deformable Object Class Modelling using Curve Matching

Mukta Prasad, Andrew Fitzgibbon, Andrew Zisserman, Luc Van Gool
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
San Francisco, June 2010


An image search for a "clownfish" yields many photos of clownfish, each of a different individual of a different 3D shape in a different pose. Yet, to the human observer, this set of images contains enough information to infer the underlying 3D deformable object class. Our goal is to recover such a deformable object class model directly from unordered images. For classes where feature-point correspondences can be found, this is a straightforward extension of non-rigid factorization, yielding a set of 3D basis shapes to explain the 2D data. However, when each image is of a different object instance, surface texture is generally unique to each individual, and does not give rise to usable image point correspondences. We overcome this sparsity using curve correspondences (crease-edge silhouettes or class-specific internal texture edges). Even rigid contour reconstruction is difficult due to the lack of reliable correspondences. We incorporate correspondence variation into the optimization, thereby extending contour-based reconstruction techniques to deformable object modelling. The notion of correspondence is extended to include mappings between 2D image curves and corresponding parts of the desired 3D object surface. Combined with class-specific priors, our method enables effective deformable class reconstruction from unordered images, despite significant occlusion and the scarcity of shared 2D image features.

Download in pdf format
  author = {Mukta Prasad and Andrew Fitzgibbon and Andrew Zisserman and Luc Van Gool},
  title = {Finding Nemo: Deformable Object Class Modelling using Curve Matching},
  booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition},
  year = {2010},
  month = {June},
  pages = {1720-1727},
  keywords = { structure from motion 3D basis shape class-specific internal edge clownfish lily contour reconstruction silhouette curve matching deformable object class modelling feature correspondence nonrigid factorization surface}