After lots of trial and error I finally managed to build NVDIFFREC and train the example model of bob - enjoy

Joint optimization of topology, materials and lighting from multi-view image observations as described in the paper Extracting Triangular 3D Models, Materials, and Lighting From Images.

For differentiable marching tetrahedons, we have adapted code from NVIDIA’s Kaolin: A Pytorch Library for Accelerating 3D Deep Learning Research.

Licenses

Copyright © 2022, NVIDIA Corporation. All rights reserved.

This work is made available under the Nvidia Source Code License.

For business inquiries, please visit our website and submit the form: NVIDIA Research Licensing.

Model from https://www.cs.cmu.edu/~kmcrane/Projects/ModelRepository/

Model and associated data is dedicated under CC0 1.0 Universal.