Augmented reality biomechanical simulations for pelvic conditions diagnoses

Digital tools are increasingly used for intraoperative assistance. Initially designed for training and learning, finite element simulations are now used and considered essential in the operating room and can be used to display through augmented reality (AR) the internal structures (vessels, tumors, etc.) on top of the intraoperative images. An essential advantage of biomechanical models lies in their ability to predict structures' behavior, providing a physics-based extrapolation, not just geometric, in areas where few or no intraoperative data are available. Yet, a significant difficulty for training simulations and biomechanical AR for medical purposes concerns the need for real-time computing without sacrificing accuracy. This chapter shows a generic constraint-based biomechanical framework that allows for the simulations of complex interactions (such as friction, contacts, etc.) but also imposes displacements and correct modeling errors using intraoperative images. As an example of possible clinical outcomes, this modeling and simulation are used to build a decision-making software that helps diagnosing pelvic pathologies.