Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Supervised forecasting of sequential data in Python.

Pytorch implementation of YOLOX、PPYOLO、PPYOLOv2、FCOS an so on.

A PyTorch Library for Accelerating 3D Deep Learning Research

SalFBNet: Learning Pseudo-Saliency Distribution via Feedback Convolutional Networks

One-Shot Neural Ensemble Architecture Search by Diversity-Guided Search Space Shrinking

Space Invaders For Python

Marvis is Mastouri's Jarvis version of the AI-powered Python personal assistant.

Face and Body Tracking for VRM 3D models on the web.

Fast and exact ILP-based solvers for the Minimum Flow Decomposition (MFD) problem, and variants of it.

Double pendulum simulator using a symplectic Euler's method and Hamiltonian mechanics

PyTorch implementation of DARDet: A Dense Anchor-free Rotated Object Detector in Aerial Images

Cortex-compatible model server for Python and TensorFlow

Neon-erc20-example - Example of creating SPL token and wrapping it with ERC20 interface in Neon EVM

Official repository of the paper 'Essentials for Class Incremental Learning'

Finite difference solution of 2D Poisson equation. Can handle Dirichlet, Neumann and mixed boundary conditions.

GPOEO is a micro-intrusive GPU online energy optimization framework for iterative applications

A (PyTorch) imbalanced dataset sampler for oversampling low frequent classes and undersampling high frequent ones.

This project aims at providing a concise, easy-to-use, modifiable reference implementation for semantic segmentation models using PyTorch.

Official Code Implementation of the paper : XAI for Transformers: Better Explanations through Conservative Propagation

Array Camera Ptychography