Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Code, final versions, and information on the Sparkfun Graphical Datasheets

Structure-Preserving Deraining with Residue Channel Prior Guidance (ICCV2021)

Doods2 - API for detecting objects in images and video streams using Tensorflow

Defending against Model Stealing via Verifying Embedded External Features

AIR^2 for Interaction Prediction

Face and Body Tracking for VRM 3D models on the web.

Tello Drone Trajectory Tracking

An implementation of the AdaOPS (Adaptive Online Packing-based Search), which is an online POMDP Solver used to solve problems defined with the POMDPs.jl generative interface.

BlueFog Tutorials

A collection of implementations of deep domain adaptation algorithms

Pop-Out Motion: 3D-Aware Image Deformation via Learning the Shape Laplacian (CVPR 2022)

Code for ICCV 2021 paper "HuMoR: 3D Human Motion Model for Robust Pose Estimation"

OpenAi's gym environment wrapper to vectorize them with Ray

Dewarping Document Image By Displacement Flow Estimation with Fully Convolutional Network.

A python software that can help blind people find things like laptops, phones, etc the same way a guide dog guides a blind person in finding his way.

A list of all papers and resoureces on Semantic Segmentation

rliable is an open-source Python library for reliable evaluation, even with a handful of runs, on reinforcement learning and machine learnings benchmarks.

OpenMatch: Open-set Consistency Regularization for Semi-supervised Learning with Outliers (NeurIPS 2021)

An Open-Source Package for Information Retrieval.

The implementation of our CIKM 2021 paper titled as: "Cross-Market Product Recommendation"