OctNet: Learning Deep 3D Representations at High Resolutions




We present OctNet, a representation for deep learning with sparse 3D data. In contrast to existing models, our representation enables 3D convolutional networks which are both deep and high resolution. Towards this goal, we exploit the sparsity in the input data to hierarchically partition the space using a set of unbalanced octrees where each leaf node stores a pooled feature representation. This allows to focus memory allocation and computation to the relevant dense regions and enables deeper networks without compromising resolution. We demonstrate the utility of our OctNet representation by analyzing the impact of resolution on several 3D tasks including 3D object classification, orientation estimation and point cloud labeling.

Author(s): Gernot Riegler and Ali Osman Ulusoy and Andreas Geiger
Journal: Arxiv
Year: 2016

Department(s): Autonomous Vision
Bibtex Type: Article (article)
Paper Type: Technical Reports

Links: pdf


  title = {OctNet: Learning Deep 3D Representations at High Resolutions},
  author = {Riegler, Gernot and Ulusoy, Ali Osman and Geiger, Andreas},
  journal = {Arxiv},
  year = {2016}