VIRTOOAIR: Virtual Reality TOOlbox for Avatar Intelligent Reconstruction

Realistic full-body avatar representation inside Virtual Reality is a big shortcoming of state-of-the-art VR systems. It remains a technically challenging task to capture human motion precisely without marker-based full-body tracking systems, which are expensive and impractical. Trying to tackle this challenge, we propose a simple yet efficient approach for avatar motion reconstruction. VIRTOOAIR (VIrtual Reality TOOlbox for Avatar Intelligent Reconstruction) combines Deep Learning for upper body reconstruction and most recent methods for single camera based pose recovery for the lower body parts. Our preliminary results demonstrate the advantages of our system's avatar pose reconstruction. This is mainly determined by the use of a powerful learning system, which offers significantly better results than existing heuristic solutions for inverse kinematics. Our system supports the paradigm shift towards learning systems capable to track full-body avatars inside Virtual Reality without the need of expensive external tracking hardware.