研究目的
To enable material-aware 3D shape analysis by learning material-aware descriptors from view-based representations of 3D points for point-wise material classification or material-aware retrieval.
研究成果
The study presents a supervised learning pipeline to compute material-aware local descriptors for untextured 3D shapes and develops the first crowdsourced dataset of 3D shapes with per-part physical material labels. The learned descriptors are demonstrated to be effective for automatic texturing, material-aware retrieval, and physical simulation.
研究不足
The study is limited to a small set of materials with tolerably discriminative geometric differences between their typical parts. The projective architecture depends on rendered images and can hence process only visible parts of shapes. The CRF-based smoothing is only a weak regularizer and cannot correct gross inaccuracies in the unary predictions.
1:Experimental Design and Method Selection:
The study employs a projective convolutional neural network architecture to learn material-aware descriptors from view-based representations of 3D points.
2:Sample Selection and Data Sources:
A dataset of 3080 3D shapes with part-wise material labels was crowdsourced, focusing on furniture models. An expert-labeled benchmark of 115 shapes from Herman-Miller and IKEA was also created for evaluation.
3:List of Experimental Equipment and Materials:
The study uses a multi-view convolutional neural network (MVCNN) based on GoogLeNet for processing shapes.
4:Experimental Procedures and Operational Workflow:
The network is trained in a Siamese fashion with a multi-task loss function that includes a multi-class binary cross-entropy loss for material classification and a contrastive loss to align 3D points in descriptor space.
5:Data Analysis Methods:
The effectiveness of the learned descriptors is evaluated for automatic texturing, material-aware retrieval, and physical simulation.
独家科研数据包,助您复现前沿成果,加速创新突破
获取完整内容