PairNorm

Official pytorch source code for PairNorm paper (ICLR 2020)
This code requires pytorch_geometric>=1.3.2

usage

For SGC, we use original PairNorm. Notice norm_scale is data-dependent. One can choose it from {0.1, 1, 10, 50}.

python main.py --data cora --model SGC --nlayer 40 --missing_rate 100 --norm_mode PN --norm_scale 10

For GCN or GAT, we use PairNorm-SI or SCS.

python main.py --data cora --model DeepGCN --nlayer 10 --missing_rate 100 --norm_mode PN-SI --residual 0
python main.py --data cora --model DeepGAT --nlayer 10 --missing_rate 100 --norm_mode PN-SCS --residual 0

update: normalization and PN

we have found that PN works bad with symmetric normalized adjacency matrix, originally the experiments align with the paper used row-normalized adjacency matrix. What's more, we also found a small bug in the old experiments with using PN for GCN and GAT. The current version PN should works good for GCN and GAT also (haven't fully tested). Please start from using PN before testing PN-SI and PN-SCS.

For GCN or GAT, now using PN to start.

python main.py --data cora --model DeepGCN --nlayer 10 --missing_rate 100 --norm_mode PN --residual 0
python main.py --data cora --model DeepGAT --nlayer 10 --missing_rate 100 --norm_mode PN --residual 0

cite

If you use our code, please cite

@inproceedings{
zhao2020pairnorm,
title={PairNorm: Tackling Oversmoothing in {\{}GNN{\}}s},
author={Lingxiao Zhao and Leman Akoglu},
booktitle={International Conference on Learning Representations},
year={2020},
url={https://openreview.net/forum?id=rkecl1rtwB}
}

Source code for PairNorm (ICLR 2020)

Related tags

Overview

PairNorm

usage

update: normalization and PN

cite

Owner

DWIPrep is a robust and easy-to-use pipeline for preprocessing of diverse dMRI data.

Code for paper " AdderNet: Do We Really Need Multiplications in Deep Learning?"

Code for paper "ASAP-Net: Attention and Structure Aware Point Cloud Sequence Segmentation"

Supervised 3D Pre-training on Large-scale 2D Natural Image Datasets for 3D Medical Image Analysis

Official PyTorch Implementation for "Recurrent Video Deblurring with Blur-Invariant Motion Estimation and Pixel Volumes"

Pre-trained BERT Models for Ancient and Medieval Greek, and associated code for LaTeCH 2021 paper titled - "A Pilot Study for BERT Language Modelling and Morphological Analysis for Ancient and Medieval Greek"

A Java implementation of the experiments for the paper "k-Center Clustering with Outliers in Sliding Windows"

This repository contains all data used for writing a research paper Multiple Object Trackers in OpenCV: A Benchmark, presented in ISIE 2021 conference in Kyoto, Japan.

LibFewShot: A Comprehensive Library for Few-shot Learning.

Source code for paper "Deep Superpixel-based Network for Blind Image Quality Assessment"

ArcaneGAN by Alex Spirin

Code repository for "Free View Synthesis", ECCV 2020.

PaddleViT: State-of-the-art Visual Transformer and MLP Models for PaddlePaddle 2.0+

Official implementation for "Low-light Image Enhancement via Breaking Down the Darkness"

An implementation of a sequence to sequence neural network using an encoder-decoder

In this project we predict the forest cover type using the cartographic variables in the training/test datasets.

SHIFT15M: multiobjective large-scale fashion dataset with distributional shifts

TransVTSpotter: End-to-end Video Text Spotter with Transformer

An implementation of the Contrast Predictive Coding (CPC) method to train audio features in an unsupervised fashion.

This is a simple face recognition mini project that was completed by a team of 3 members in 1 week's time