This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Search for Publication

Year(s) from:  to 
Keywords (separated by spaces):

Comparing Automatic Simulator Assessment with Expert Assessment of Virtual Surgical Procedures

S. Tuchschmid, M. Bajka and M. Harders
January 2010


This study focuses on the comparison of expert assessment of virtual surgical procedures through Objective Structured Assessment of Technical Skills (OSATS) with the automatic assessment and feedback provided by a surgical simulator for hysteroscopic procedures. The existing multi-metric scoring system of the simulator was extended to include hysteroscopic myomectomy. The original OSATS was also modified for the examined surgical procedure. OSATS reliability, expert coherence, and interrater agreement with simulator feedback were investigated in a study with eight experts. The same selection of six movies showing virtual procedures performed at a hysteroscopy training course was rated by each expert. For the task-specific checklist, the reliability of the simulator was significantly higher than that of the individual human raters (p=0.006). In addition, the ranked order of the overall scores of all movies was the same for both simulator and expert consensus opinion. This is a first step to providing simulator feedback with the same reliability as an expert panel, thus facilitating competency-based surgical education and assessment in the near future.

Link to publisher's page
Download in pdf format
  author = {S. Tuchschmid and M. Bajka and M. Harders},
  title = {Comparing Automatic Simulator Assessment with Expert Assessment of Virtual Surgical Procedures},
  booktitle = {ISMBS},
  year = {2010},
  month = {January},
  pages = {181-191},
  volume = {5958},
  series = {Lecture Notes in Computer Science},
  keywords = {}