PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Last update: Dec 28, 2022

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

This is the official PyTorch implementation of the ContrastiveCrop paper:

@article{peng2022crafting,
  title={Crafting Better Contrastive Views for Siamese Representation Learning},
  author={Peng, Xiangyu and Wang, Kai and Zhu, Zheng and You, Yang},
  journal={arXiv preprint arXiv:2202.03278},
  year={2022}
}

This repo includes PyTorch implementation of SimCLR, MoCo, BYOL and SimSiam, as well as their DDP training code.

Preparation

Create a python enviroment with pytorch >= 1.8.1.
pip install -r requirements.txt
Modify dataset root in the config file.

Pre-train

# MoCo, CIFAR-10
python DDP_moco_ccrop.py configs/small/cifar10/moco_alpha0.1_th0.1.py

# SimSiam, CIFAR-100
python DDP_simsiam_ccrop.py configs/small/cifar100/simsiam_alpha0.1_th0.1.py

Linear Evaluation

# CIFAR-10
python DDP_linear.py configs/linear/cifar10_res18.py --load ./checkpoints/small/cifar10/moco_alpha0.1_th0.1/last.pth

# CIFAR-100
python DDP_linear.py configs/linear/cifar100_res18.py --load ./checkpoints/small/cifar100/simsiam_alpha0.1_th0.1/last.pth

More models and datasets coming soon.

PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

Preparation

Pre-train

Linear Evaluation

Owner

PyTorch implementation of the paper Dynamic Data Augmentation with Gating Networks

code for paper "Does Unsupervised Architecture Representation Learning Help Neural Architecture Search?"

Code for BMVC2021 paper "Boundary Guided Context Aggregation for Semantic Segmentation"

Hunt down social media accounts by username across social networks

Nodule Generation Algorithm Baseline and template code for node21 generation track

This repository contains the needed resources to build the HIRID-ICU-Benchmark dataset

A Comparative Framework for Multimodal Recommender Systems

Code for ICCV 2021 paper "Distilling Holistic Knowledge with Graph Neural Networks"

Rot-Pro: Modeling Transitivity by Projection in Knowledge Graph Embedding

A simple consistency training framework for semi-supervised image semantic segmentation

LWCC: A LightWeight Crowd Counting library for Python that includes several pretrained state-of-the-art models.

Graph Regularized Residual Subspace Clustering Network for hyperspectral image clustering

ScriptProfilerPy - Module to visualize where your python script is slow

3D detection and tracking viewer (visualization) for kitti & waymo dataset

Lbl2Vec learns jointly embedded label, document and word vectors to retrieve documents with predefined topics from an unlabeled document corpus.

Colossal-AI: A Unified Deep Learning System for Large-Scale Parallel Training

RMTD: Robust Moving Target Defence Against False Data Injection Attacks in Power Grids

Code release for "Detecting Twenty-thousand Classes using Image-level Supervision".

Source code for From Stars to Subgraphs

Vision Deep-Learning using Tensorflow, Keras.