Primitive-based 3D Human-Object Interaction Modelling and Programming

Published in AAAI, 2024

Siqi Liu, Yong-Lu Li, Zhou Fang, Xinpeng Liu, Yang You, Cewu Lu

arXiv / PDF / project page / BibTeX

Abstract

Embedding Human and Articulated Object Interaction (HAOI) in 3D is crucial for understanding human activities. Unlike previous works using parametric and CAD models, we propose a novel approach using 3D geometric primitives to encode both humans and objects. In our paradigm, humans and objects are compositions of primitives, enabling mutual information learning between limited 3D human data and various object categories. We choose superquadrics as our primitive representation for their simplicity and rich information. We introduce a new 3D HAOI benchmark with primitives and their images and propose a task for machines to recover 3D HAOI from images. Additionally, we provide a baseline for single-view 3D reconstruction on HAOI, paving the way for future 3D HAOI research.

BibTeX

@inproceedings{liu2024primitivebased,
  title     = {Primitive-based 3D Human-Object Interaction Modelling and Programming},
  author    = {Siqi Liu and Yong-Lu Li and Zhou Fang and Xinpeng Liu and Yang You and Cewu Lu},
  booktitle = {AAAI Conference on Artificial Intelligence (AAAI)},
  year      = {2024},
  eprint    = {2312.10714},
  archivePrefix = {arXiv}
}

Recommended citation: Liu, S., Li, Y. L., Fang, Z., Liu, X., You, Y., & Lu, C. (2023). Primitive-based 3D Human-Object Interaction Modelling and Programming. arXiv preprint arXiv:2312.10714.