DeepMind Robotics

Libraries, tools and tasks created and used at DeepMind Robotics.

Package overview

Package	Summary
Transformations	Rigid body transformations
Geometry	Scene and Robot geometry primitives
Vision	Visual blob detection and tracking
AgentFlow	Reinforcement Learning agent composition library
Manipulation	"RGB" object meshes for manipulation tasks
MoMa	Manipulation environment definition library, for simulated and real robots
Controllers	QP-optimization based cartesian controller
Controller Bindings	Python bindings for the controller
Least Squares QP	QP task definition and solver

Installation

These libraries are distributed on PyPI, the packages are:

dm_robotics-transformations
dm_robotics-geometry
dm_robotics-vision
dm_robotics-agentflow
dm_robotics-manipulation
dm_robotics-moma
dm_robotics-controllers

Dependencies

MoMa, Manipulation and Controllers depend on MuJoCo, the other packages do not. See the individual packages for more information on their dependencies.

Building

To build and test the libraries, run build.sh. This script assumes:

MuJoCo is installed and licensed.
dm_control is installed.
cmake version >= 3.20.2 is installed.
Python 3.6 ,3.7 or 3.8 and system headers are installed.
GCC version 9 or later is installed.
numpy is installed.

The Python libraries are tested with tox, the C++ code is built and tested with cmake.

Tox's distshare mechanism is used to share the built source distribution packages between the packages.

Libraries, tools and tasks created and used at DeepMind Robotics.

Related tags

Overview

DeepMind Robotics

Package overview

Installation

Dependencies

Building

Owner

DeepMind

Compact Bidirectional Transformer for Image Captioning

MaskTrackRCNN for video instance segmentation based on mmdetection

Hierarchical Few-Shot Generative Models

Point detection through multi-instance deep heatmap regression for sutures in endoscopy

Bayesian Neural Networks in PyTorch

Adversarial Learning for Modeling Human Motion

Object Detection and Multi-Object Tracking

RL Algorithms with examples in Python / Pytorch / Unity ML agents

An algorithm study of the 6th iOS 10 set of Boost Camp Web Mobile

Implementation of DropLoss for Long-Tail Instance Segmentation in Pytorch

PyBrain - Another Python Machine Learning Library.

Code artifacts for the submission "Mind the Gap! A Study on the Transferability of Virtual vs Physical-world Testing of Autonomous Driving Systems"

A minimal solution to hand motion capture from a single color camera at over 100fps. Easy to use, plug to run.

This is the implementation of the paper "Self-supervised Outdoor Scene Relighting"

Official PyTorch implementation of RobustNet (CVPR 2021 Oral)

Implementation of gaze tracking and demo

[ICCV2021] Official code for "Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognition"

FPGA: Fast Patch-Free Global Learning Framework for Fully End-to-End Hyperspectral Image Classification

Object Tracking and Detection Using OpenCV

TCube generates rich and fluent narratives that describes the characteristics, trends, and anomalies of any time-series data (domain-agnostic) using the transfer learning capabilities of PLMs.