This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

2D Action Recognition Serves 3D Human Pose Estimation

J. Gall, A. Yao and L. Van Gool
European Conference on Computer Vision


3D human pose estimation in multi-view settings benefits from embeddings of human actions in low-dimensional manifolds, but the complexity of the embeddings increases with the number of actions. Creating separate, action-specific manifolds seems to be a more practical solution. Using multiple manifolds for pose estimation, however, requires a joint optimization over the set of manifolds and the human pose embedded in the manifolds. In order to solve this problem, we propose a particle-based optimization algorithm that can efficiently estimate human pose even in challenging in-house scenarios. In addition, the algorithm can directly integrate the results of a 2D action recognition system as prior distribution for optimization. In our experiments, we demonstrate that the optimization handles an 84D search space and provides already competitive results on HumanEva with as few as 25 particles.

Download in pdf format
  author = {J. Gall and A. Yao and L. Van Gool},
  title = {2D Action Recognition Serves 3D Human Pose Estimation},
  booktitle = {European Conference on Computer Vision},
  year = {2010},
  volume = {6311- 6316},
  series = {Lecture Notes in Computer Science},
  publisher = {Springer},
  keywords = {optimization, human pose estimation, dimensionality reduction, action recognition}