Differentiable Annealed Importance Sampling (DAIS)

This repository contains the code to reproduce the DAIS results from the paper Differentiable Annealed Importance Sampling and the Perils of Gradient Noise.

Bayesian Linear Regression

Please first install JAX (https://github.com/google/jax), then reproduce our results by running the following:

python blr/dais.py --gamma 0.0
python blr/dais.py --gamma 0.9
python blr.dais.py --bsize 100

Variational Autoencoder

Please first install PyTorch (https://pytorch.org/).

For training, one example command for DAIS with $K = 10$ and $S = 5$ (to adapt annealing scheme, add --adapt_beta):

python vae/mnist_train.py --lf_step 10 --n_particles 5 --lf_lrate 0.08

After training, you can find the saved checkpoint and evaluate it (e.g., using AIS):

python vae/mnist_eval.py --ais --n_particles 10 --lf_step 10000 --lf_lrate 0.05 --resume xxx

Also, you can reproduce the evaulation results of AIS/HAIS/DAIS by runing vae/mnist_eval_scaling.py:

python vae/mnist_eval_scaling.py --linear_beta --lf_lrate 0.08 --n_particles 10 --resume xxx

Citation

To cite this work, please use

@inproceedings{
	zhang2021differentiable,
	title={Differentiable Annealed Importance Sampling and the Perils of Gradient Noise},
	author={Guodong Zhang and Kyle Hsu and Jianing Li and Chelsea Finn and Roger Baker Grosse},
	booktitle={Thirty-Fifth Conference on Neural Information Processing Systems},
	year={2021},
	url={https://openreview.net/forum?id=6rqjgrL7Lq}
}

Differentiable Annealed Importance Sampling (DAIS)

Related tags

Overview

Differentiable Annealed Importance Sampling (DAIS)

Bayesian Linear Regression

Variational Autoencoder

Citation

Owner

Guodong Zhang

An implementation of the AlphaZero algorithm for Gomoku (also called Gobang or Five in a Row)

Python periodic table module

Face Recognition & AI Based Smart Attendance Monitoring System.

Imbalanced Gradients: A Subtle Cause of Overestimated Adversarial Robustness

NHL 94 AI contests

Video Matting Refinement For Python

Official implementation of VaxNeRF (Voxel-Accelearated NeRF).

Relative Uncertainty Learning for Facial Expression Recognition

Code and datasets for the paper "Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Prediction" (RA-L, 2021)

This repo contains the pytorch implementation for Dynamic Concept Learner (accepted by ICLR 2021).

Official Code for "Non-deep Networks"

The code for paper "Contrastive Spatio-Temporal Pretext Learning for Self-supervised Video Representation" which is accepted by AAAI 2022

Differentiable architecture search for convolutional and recurrent networks

A Graph Neural Network Tool for Recovering Dense Sub-graphs in Random Dense Graphs.

Classifying cat and dog images using Kaggle dataset

Efficient Two-Step Networks for Temporal Action Segmentation (Neurocomputing 2021)

[NeurIPS 2021] Garment4D: Garment Reconstruction from Point Cloud Sequences

A Player for Kanye West's Stem Player. Sort of an emulator.

Implementation of the paper titled "Using Sampling to Estimate and Improve Performance of Automated Scoring Systems with Guarantees"

Learned Initializations for Optimizing Coordinate-Based Neural Representations