Vision-Based Categorical Object Pose Estimation and Manipulation.

Object manipulation and environment interaction are of great significance for intelligent robots, especially service robots working under unstructured household and office scenarios. This paper proposes a novel approach for categorical unseen object grasping and manipulation. Different from recently popular end-to-end reinforcement learning methods, we develop models for geometric primitive abstraction of target objects, and accordingly estimate their pose as well as generate task-orientated grasp points. Such design emphasizes visual perception in guiding robotic manipulation, thereby enhancing model interpretability and reliability during implementation. In addition, we also conduct object grasping experiments both under simulation and real-world settings, which further verify the effectiveness and superiority of our method.