Uteraug : Augmented Reality in Laparoscopic Surgery of the Uterus

One of the goals of medical Augmented Reality (AR) is to reveal the hidden anatomy, such as a tumour or major blood vessels within an organ. We present Uteraug: a real-time state-of-the-art AR system for locating tumours within the human uterus in gynaecological laparosurgery. The system works by registering a preoperative volume, such as MRI and fusing it in real-time with the laparoscopic video. Several related AR systems exist for AR guidance with other organs such as the liver or kidney, however ours is the first to achieve automatic, robust and markerless registration in real-time and the first to be validated in live use in the operating room (OR). Our system is based on [3] with some important improvements to allow it to be used by the medical staff, which is essential for its wide-spread adoption. It has been improved to both reduce the time requirement for system initialization and to overcome ergonomic limitations, allowing its use by a clinician operator.