3D Human Reconstruction Combined with Facial Features

The Metaverse is a shared virtual space that allows individuals to interact with other users in a digital environment. Therefore, constructing a real 3D human body model in the Metaverse as a mapping of the real world is an indispensable content. It is currently very challenging to accurately and robustly model a 3D human body from a single image. The main problem is how to accurately reconstruct the detailed texture of the character, especially the facial texture that best characterizes the identity of the character. Therefore, we propose a 3D human reconstruction algorithm combined with facial features. By predicting the parameters of the 3DMM model, we construct a 3D facial model, extract the corresponding 3D facial features, and fuse them with the 2D image features to jointly realize the implicit prediction of the 3D human body. The method introduces 3D face model as prior knowledge, which greatly improves the accuracy of 3D human face reconstruction.