An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

Last update: Nov 09, 2021

Related tags

Deep Learning EquivariantSelfAttention

Overview

EquivariantSelfAttention

An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

This work extends and builds on previous work:

FR Classification using e2cnn, whose code is here.
Attention for FR Classificaion, whose code is here. This work makes extensive use of the e2cnn package: e2cnn.

Imports for General Use

import os
import torch
import e2cnn
import pandas as pd
import numpy as np
import configparser as ConfigParser

import utils

Loading a network:

To load a network import the network files, read in a config file, and load the network with the config file parameters:

from networks import AGRadGalNet, VanillaLeNet, testNet, DNSteerableLeNet, DNSteerableAGRadGalNet
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

config      = ConfigParser.ConfigParser(allow_no_value=True)
config_path = "configs/CONFIG_NAME"
config.read(config_path)

net = locals()[config['model']['base']](**config['model']).to(device)

Alternatively, if you know which architecture you want to use, only import that and load in the config parameters (i.e. without using locals()):

from networks import DNSteerableAGRadGalNet
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")

config      = ConfigParser.ConfigParser(allow_no_value=True)
config_path = "configs/CONFIG_NAME"
config.read(config_path)

net = DNSteerableAGRadGalNet(**config['model']).to(device)

Loading a model:

To load the best performing model (according to early stopping) from a given model training session:

path_supliment = config['data']['augment']+'/'
model = utils.utils.load_model(config, load_model='best', device=device, path_supliment=path_supliment)

Testing a model:

Follow the example of evaluation.ipynb for model evaluation.

Defining a model:

To define your own model simply create a new config which follows the examples provided in configs.

Training a model:

To train a model use the train.py using your config file:

python3.8 train.py --config YOUR_CONFIG_NAME.cfg >& logs/YOUR_CONFIG_NAME.log

An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

Related tags

Overview

EquivariantSelfAttention

Imports for General Use

Loading a network:

Loading a model:

Testing a model:

Defining a model:

Training a model:

Owner

This repository implements WGAN_GP.

PyTorch Implementation for "ForkGAN with SIngle Rainy NIght Images: Leveraging the RumiGAN to See into the Rainy Night"

Distributing Deep Learning Hyperparameter Tuning for 3D Medical Image Segmentation

Rule Based Classification Project For Python

Code implementing "Improving Deep Learning Interpretability by Saliency Guided Training"

PyTorch deep learning projects made easy.

The Pytorch implementation for "Video-Text Pre-training with Learned Regions"

A PyTorch Implementation of Gated Graph Sequence Neural Networks (GGNN)

make ASCII Art by Deep Learning

[ICCV 2021] FaPN: Feature-aligned Pyramid Network for Dense Image Prediction

Split Variational AutoEncoder

Testbed of AI Systems Quality Management

VideoGPT: Video Generation using VQ-VAE and Transformers

PyTorch implementation of DeepLab v2 on COCO-Stuff / PASCAL VOC

Autoencoders pretraining using clustering

Implementation of Nalbach et al. 2017 paper.

CARL provides highly configurable contextual extensions to several well-known RL environments.

Training neural models with structured signals.

Karate Club: An API Oriented Open-source Python Framework for Unsupervised Learning on Graphs (CIKM 2020)

Pgn2tex - Scripts to convert pgn files to latex document. Useful to build books or pdf from pgn studies