Jacobian-Free Backprop

Associated Publication

JFB: Jacobian-Free Backpropagation for Implicit Models (arXiv Link)

@article{WuFung2022JFB,
    title={JFB: Jacobian-Free Backpropagation for Implicit Models},
    author={Fung, Samy Wu and Heaton, Howard and Li, Qiuwei and McKenzie, Daniel and Osher, Stanley and Yin, Wotao},
    journal={Proceedings of the AAAI Conference on Artificial Intelligence},
    year={2022}
}

Set-up

Install all the requirements:

pip install -r requirements.txt

Training

For each dataset, there are three types of training drivers:

FPN with our proposed backprop:

	python train_CIFAR10.py
	python train_CIFAR10_Unaugmented.py
	python train_MNIST.py
	python train_SVHN.py

FPN with Jacobian-based backprop:

	python train_CIFAR10_Jacobian_Based.py
	python train_CIFAR10_Unaugmented_Jacobian_Based.py
	python train_MNIST_Jacobian_Based.py
	python train_SVHN_Jacobian_Based.py

Explicit models.

	python train_CIFAR10_Explicit.py
	python train_CIFAR10_Unaugmented_Explicit.py
	python train_MNIST_Explicit.py
	python train_SVHN_Explicit.py

JFB: Jacobian-Free Backpropagation for Implicit Models

Related tags

Overview

Jacobian-Free Backprop

Associated Publication

Set-up

Training

Owner

Typal Research

Pytorch implementation of Bert and Pals: Projected Attention Layers for Efficient Adaptation in Multi-Task Learning

Python periodic table module

paper list in the area of reinforcenment learning for recommendation systems

Hypernetwork-Ensemble Learning of Segmentation Probability for Medical Image Segmentation with Ambiguous Labels

Implementation of popular SOTA self-supervised learning algorithms as Fastai Callbacks.

Collective Multi-type Entity Alignment Between Knowledge Graphs (WWW'20)

ML From Scratch

Official NumPy Implementation of Deep Networks from the Principle of Rate Reduction (2021)

Plug-n-Play Reinforcement Learning in Python with OpenAI Gym and JAX

A custom DeepStack model that has been trained detecting ONLY the USPS logo

Unified learning approach for egocentric hand gesture recognition and fingertip detection

Matlab Python Heuristic Battery Opt - SMOP conversion and manual conversion

Implementation of the paper "Language-agnostic representation learning of source code from structure and context".

OpenMMLab Image and Video Editing Toolbox

PySLM Python Library for Selective Laser Melting and Additive Manufacturing

FridaHookAppTool - Frida Hook App Tool With Python

Surrogate-Assisted Genetic Algorithm for Wrapper Feature Selection

LSTM model trained on a small dataset of 3000 names written in PyTorch

Code for AA-RMVSNet: Adaptive Aggregation Recurrent Multi-view Stereo Network (ICCV 2021).

PyTorch implementation of Advantage Actor Critic (A2C), Proximal Policy Optimization (PPO), Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation (ACKTR) and Generative Adversarial Imitation Learning (GAIL).