Within the Dynamic Context: Inertia-aware 3D Human Modeling with Pose Sequence
arxiv(2024)
摘要
Neural rendering techniques have significantly advanced 3D human body
modeling. However, previous approaches often overlook dynamics induced by
factors such as motion inertia, leading to challenges in scenarios like abrupt
stops after rotation, where the pose remains static while the appearance
changes. This limitation arises from reliance on a single pose as conditional
input, resulting in ambiguity in mapping one pose to multiple appearances. In
this study, we elucidate that variations in human appearance depend not only on
the current frame's pose condition but also on past pose states. Therefore, we
introduce Dyco, a novel method utilizing the delta pose sequence representation
for non-rigid deformations and canonical space to effectively model temporal
appearance variations. To prevent a decrease in the model's generalization
ability to novel poses, we further propose low-dimensional global context to
reduce unnecessary inter-body part dependencies and a quantization operation to
mitigate overfitting of the delta pose sequence by the model. To validate the
effectiveness of our approach, we collected a novel dataset named I3D-Human,
with a focus on capturing temporal changes in clothing appearance under
approximate poses. Through extensive experiments on both I3D-Human and existing
datasets, our approach demonstrates superior qualitative and quantitative
performance. In addition, our inertia-aware 3D human method can unprecedentedly
simulate appearance changes caused by inertia at different velocities.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要