PiFU HD (2D to 3D)

Based on the PiFU neural network, we have created a web service in which a 3D model of a person is created from one photo, with the ability to view it in augmented reality. This approach significantly reduces the time required to create 3D content, especially using human images.

Technical features

web interface – written in JS

server part – written in Python

Machine learning models used – written in PyTorch

Example of creating a 3D model

Example of watching a 3D model in AR

We also ran an experiment with animating one of these final 3D models and used an image of Will Smith, one of the techno geeks that is very similar to us!