Neural Material

Official code repository for the paper:

Generative Modelling of BRDF Textures from Flash Images [SIGGRAPH Asia, 2021]

Henzler, Deschaintre, J. Mitra, Ritschel

[Paper] [Project page]

Data

The dataset is stored under flash_images and contains 306 train folders and 116 test folders (including images from Aitalla et al).

Install dependencies

conda create -n neuralmaterial python=3.8
conda activate neuralmaterial
pip install hydra-core --upgrade
pip install tqdm
conda install pytorch==1.7.1 torchvision==0.8.2 cudatoolkit=10.1 -c pytorch

Training

For training please run

python scripts/train.py

The default config is located at config/config_default.yaml.

Inference

Note, is a relative path in the flash_images/test and is exptected to be located in the trainings/ folder.

Synthesis

In order to synthesise given flash images located in the test folder please run

python scripts/test.py --model 
   
     --test_image_id 
    
      --finetune 
     

     
    
   

Interpolation

Given two images for interpolation please run

python scripts/interpolate.py --model 
   
     --weights1 
    
      --weights2 
     
       --test_image_id1 
      
        --test_image_id2 
        
       
      
     
    
   

If you would like to use fine-tuned weights please run the scripts/test.py command above in order to retrieve them.

Examples

Run the file run_examples.sh to synthesise / interpolate a few examples.

Citation

If you find our work useful in your research, please cite:

@article{henzler2021neuralmaterial,
  title={Generative Modelling of BRDF Textures from Flash Images},
  author={Henzler, Philipp and Deschaintre, Valentin and Mitra, Niloy J and Ritschel, Tobias},
  journal={ACM Trans Graph (Proc. SIGGRAPH Asia)},
  year={2021},
  volume={40},
  number={6},
}

Contact

If you have any questions, please email Philipp Henzler at [email protected].