Official pytorch code for "APP: Anytime Progressive Pruning"

Last update: Nov 22, 2022

Overview

APP: Anytime Progressive Pruning

Diganta Misra^1,2,3, Bharat Runwal^2,4, Tianlong Chen⁵, Zhangyang Wang⁵, Irina Rish^1,3

¹ Mila - Quebec AI Institute,² Landskape AI,³ UdeM,⁴ IIT-Delhi,⁵ VITA, UT-Austin

Requirements

To create a new conda environment with the dependencies used in this project, do:

conda env create -f app.yml

For running the code on Restricted-Imagenet Dataset, first install the robustness library from here and provide the imagenet_path argument as the path to the imaganet data folder.

Run the Code

Here is an example of running the Anytime Progressive Pruning (APP) on Cifar-10 dataset with 8 megabatches in total:

python main_anytime_train.py \
    --data ../data \
    --dataset cifar10 \
    --arch resnet50 \
    --seed 1 \
    --epochs 50 \
    --decreasing_lr 20,40 \
    --batch_size 64 \
    --weight_decay 1e-4 \
    --meta_batch_size 6250 \
    --meta_batch_number 8 \
    --sparsity_level 4.5 \
    --snip_size 0.20 \
    --save_dir c10_r50

One-Shot pruning :

python main_anytime_one.py \
    --data ../data \
    --dataset cifar10 \
    --arch resnet50 \
    --seed 1 \
    --epochs 50 \
    --decreasing_lr 20,40 \
    --batch_size 64 \
    --weight_decay 1e-4 \
    --meta_batch_size 6250 \
    --meta_batch_number 8 \
    --sparsity_level 4.5 \
    --snip_size 0.20 \
    --save_dir c10_OSP_r18

Baseline :

python main_anytime_baseline.py \
    --data ../data \
    --dataset cifar10 \
    --arch resnet50 \
    --seed 1 \
    --epochs 50 \
    --decreasing_lr 20,40 \
    --batch_size 64 \
    --weight_decay 1e-4 \
    --meta_batch_size 6250 \
    --meta_batch_number 8 \
    --save_dir c10_BASE_r50

Cite:

@misc{misra2022app,
    title={APP: Anytime Progressive Pruning},
    author={Diganta Misra and Bharat Runwal and Tianlong Chen and Zhangyang Wang and Irina Rish},
    year={2022},
    eprint={2204.01640},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

Official pytorch code for "APP: Anytime Progressive Pruning"

Related tags

Overview

APP: Anytime Progressive Pruning

Requirements

Run the Code

Cite:

Owner

Landskape AI

pytorch implementation of openpose including Hand and Body Pose Estimation.

Keras-1D-ACGAN-Data-Augmentation

Code for ICLR2018 paper: Improving GAN Training via Binarized Representation Entropy (BRE) Regularization - Y. Cao · W Ding · Y.C. Lui · R. Huang

Tesla Light Show xLights Guide With python

Official repository of OFA. Paper: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

A Multi-attribute Controllable Generative Model for Histopathology Image Synthesis

Cross-Modal Contrastive Learning for Text-to-Image Generation

A hue shift helper for OBS

A geometric deep learning pipeline for predicting protein interface contacts.

PyTorch implementation of Advantage Actor Critic (A2C), Proximal Policy Optimization (PPO), Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation (ACKTR) and Generative Adversarial Imitation Learning (GAIL).

AQP is a modular pipeline built to enable the comparison and testing of different quality metric configurations.

PyTorch implementation of "Simple and Deep Graph Convolutional Networks"

Implementation of the famous Image Manipulation\Forgery Detector "ManTraNet" in Pytorch

Code for ACL'2021 paper WARP 🌀 Word-level Adversarial ReProgramming

Accuracy Aligned. Concise Implementation of Swin Transformer

A set of tools for creating and testing machine learning features, with a scikit-learn compatible API

[CVPR 2022] Pytorch implementation of "Templates for 3D Object Pose Estimation Revisited: Generalization to New objects and Robustness to Occlusions" paper

A criticism of a recent paper on buggy image downsampling methods in popular image processing and deep learning libraries.

Python Implementation of the CoronaWarnApp (CWA) Event Registration

Adapter-BERT: Parameter-Efficient Transfer Learning for NLP.