A-SDF: Learning Disentangled Signed Distance Functions
for Articulated Shape Representation


Jiteng Mu, Weichao Qiu, Adam Kortylewski, Alan Yuille,
Nuno Vasconcelos, Xiaolong Wang

Paper Code(Coming Soon)

Recent work has made significant progress on using implicit functions, as a continuous representation for 3D rigid object shape reconstruction. However, much less effort has been devoted to modeling general articulated objects. Compared to rigid objects, articulated objects have a higher degree of freedom, which makes it hard to generalize to unseen shapes. To deal with the large shape variance, we introduce Disentangled Signed Distance Functions to represent articulated shapes with a structured latent space, where we have separate codes for encoding shape and articulation. We assume no prior knowledge on part geometry, articulation status, joint type, joint axis, and joint location. With this disentangled continuous representation, we demonstrate that we can control the articulation input and animate unseen instances with unseen joint angles. Furthermore, we propose a Test-Time Adaptation inference algorithm to adjust our model during inference. We demonstrate our model generalize well to out-of-distribution and unseen data, e.g., partial point clouds and real-world depth images.

Shape Generation with Real-world Depth Images


Given one real-world depth image, the proposed A-SDF is capable of generating laptops with continuous changing articulations in 3D.


Use the slider to interact with the generated shapes.

Interpolate start reference image.

Input Depth Image

Loading...
Interpolate start reference image.

Input Depth Image

Loading...

Shape Generation with Shape2motion Dataset


We first learn a category-level disentangled Signed Distance Function (A-SDF) with a structured latent space. Once learned, unseen shapes at unseen articulations can be generated by just manipulating the articulation code. Use the slider to interact with the generated shapes.

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...

Shape Interpolation with Shape2motion Dataset


Interpolated shapes by DeepSDF show unrealistic deformation, whereas the proposed A-SDF faithfully interpolates shapes in between.

Bibtex


@article{mu2021learning, author = {Mu, Jiteng and Qiu, Weichao and Kortylewski, Adam and Yuille, Alan and Vasconcelos, Nuno and Wang, Xiaolong}, title = {A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representation}, journal = {arXiv preprint arXiv: 2104.07645 }, year={2021} }