Publications

This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication


Year(s) from:  to 
Author:
Keywords (separated by spaces):

Automated Visual Input Analysis for a Telediagnostic Robot System

Thomas Probst and Andrea Fossati and Luc Van Gool
Proceedings of the 5th Joint Workshop on New Technologies for Computer/Robot Assisted Surgery
Brussels, September 2015, in press

Abstract

The European project ReMeDi aims to develop a system that allows doctors to remotely perform physical and ultrasonography examinations by teleoperating a multifunctional robotic device at the patient side. In excess of teleconferencing, haptic interfaces, force-feedback and multisensory data representing the remote environment provide proactive support for the doctor. Computer Vision methods are emplaced to serve the critical need of perceiving the patient and his distinct pose to estimate the position of the end effector with respect to the body. Also the environment is observed to provide information about the robot's workspace. Furthermore we approach the problem of analyzing the patients facial expression to assess his emotional state and pain level during examination with computer vision techniques. The interactive nature of the application require the RGB and depth data (acquired by a Kinect mounted on the robot platform and a second camera aimed at the patient's face) to be processed in real-time. Therefore our research focus lies on developing and evaluating both efficient and robust algorithms based on machine learning to meet these requirements.


Download in pdf format
@InProceedings{eth_biwi_01239,
  author = {Thomas Probst and Andrea Fossati and Luc Van Gool},
  title = {Automated Visual Input Analysis for a Telediagnostic Robot System},
  booktitle = {Proceedings of the 5th Joint Workshop on New Technologies for Computer/Robot Assisted Surgery},
  year = {2015},
  month = {September},
  keywords = {machine learning, facial expression recognition, emotion recognition, human pose estimation, real-time application},
  note = {in press}
}