Differentiable rendering demo

Here's a short demo of my reconstruction algorithm. It's a work in progress but it already works well enough to show it :) I'm optimizing the shape and appearance of an object from pictures, as well as estimating the environnement lighting from the reflections. The algorithm is implemented from scratch on the gpu with OpenGL compute shaders. The gpu used in the video is an rtx A6000. This object is particularly complex so I have to wait to make sure the optimization has converged before going to the next level of detail. I bootstrap the optimization from the visual hull and low resolution images and upscale everything progressively. The octree is updated at each iteration as voxels become transparent. There are no cameras seeing from the bottom which is why some parts are more difficult or even impossible to reconstruct.