pybaum provides tools to work with pytrees which is a concept burrowed from JAX.

Last update: May 11, 2022

Related tags

Deep Learning pybaum

Overview

pybaum

https://readthedocs.org/projects/pybaum/badge/?version=latest

https://img.shields.io/github/workflow/status/OpenSourceEconomics/pybaum/main/main

Installation

pybaum is available on PyPI and Anaconda.org. Install it with

$ pip install pybaum

# or

$ conda install -c conda-forge pybaum

About

pybaum provides tools to work with pytrees which is a concept burrowed from JAX.

What is a pytree?

In pybaum, we use the term pytree to refer to a tree-like structure built out of container-like Python objects. Classes are considered container-like if they are in the pytree registry, which by default includes lists, tuples, and dicts. That is:

Any object whose type is not in the pytree container registry is considered a leaf pytree.
Any object whose type is in the pytree container registry, and which contains pytrees, is considered a pytree.

For each entry in the pytree container registry, a container-like type is registered with a pair of functions that specify how to convert an instance of the container type to a (children, metadata) pair and how to convert such a pair back to an instance of the container type. Using these functions, pybaum can canonicalize any tree of registered container objects into tuples.

Example pytrees:

[1, "a", object()]  # 3 leaves

(1, (2, 3), ())  # 3 leaves

[1, {"k1": 2, "k2": (3, 4)}, 5]  # 5 leaves

pybaum can be extended to consider other container types as pytrees.

Comments

Fix for new jax version.

Problem

The type of a jax array has changed in jax version 0.4.1 and thus pybaum would not work with this jax version.

Solution

Handle jax arrays explicitly in get_type, as we are currently already doing for namedtuples.

opened by janosg 1
[pre-commit.ci] pre-commit autoupdate
updates:

github.com/pre-commit/pre-commit-hooks: v4.3.0 → v4.4.0

github.com/asottile/reorder_python_imports: v3.1.0 → v3.9.0

github.com/pre-commit/pre-commit-hooks: v4.3.0 → v4.4.0

github.com/psf/black: 22.3.0 → 22.12.0

github.com/PyCQA/flake8: 4.0.1 → 6.0.0

github.com/PyCQA/doc8: 0.11.2 → v1.0.0

github.com/mgedmin/check-manifest: 0.48 → 0.49

github.com/PyCQA/doc8: 0.11.2 → v1.0.0

github.com/asottile/setup-cfg-fmt: v1.20.1 → v2.2.0

github.com/codespell-project/codespell: v2.1.0 → v2.2.2

github.com/asottile/pyupgrade: v2.34.0 → v3.3.1
opened by pre-commit-ci[bot] 1
[pre-commit.ci] pre-commit autoupdate
updates:

github.com/pre-commit/pre-commit-hooks: v4.2.0 → v4.3.0

github.com/pre-commit/pre-commit-hooks: v4.2.0 → v4.3.0

github.com/PyCQA/doc8: 0.11.1 → 0.11.2

github.com/PyCQA/doc8: 0.11.1 → 0.11.2

github.com/asottile/pyupgrade: v2.32.1 → v2.34.0
opened by pre-commit-ci[bot] 1
[pre-commit.ci] pre-commit autoupdate
updates:

github.com/pre-commit/pre-commit-hooks: v4.1.0 → v4.2.0

github.com/asottile/reorder_python_imports: v2.7.1 → v3.1.0

github.com/pre-commit/pre-commit-hooks: v4.1.0 → v4.2.0

github.com/psf/black: 22.1.0 → 22.3.0

github.com/PyCQA/doc8: 0.10.1 → 0.11.1

github.com/mgedmin/check-manifest: 0.47 → 0.48

github.com/PyCQA/doc8: 0.10.1 → 0.11.1

github.com/asottile/setup-cfg-fmt: v1.20.0 → v1.20.1

github.com/asottile/pyupgrade: v2.31.0 → v2.32.1
opened by pre-commit-ci[bot] 1
Align default containers with jax
Currently we have only list, dict and tuple as default pytree containers.

Jax also has:

[x] None

[x] collections.namedtuple and typing.NamedTuple

[x] collections.OrderedDict
opened by janosg 1
[pre-commit.ci] pre-commit autoupdate
updates:

github.com/pre-commit/pre-commit-hooks: v4.0.1 → v4.1.0

github.com/asottile/reorder_python_imports: v2.6.0 → v2.7.1

github.com/pre-commit/pre-commit-hooks: v4.0.1 → v4.1.0

github.com/asottile/blacken-docs: v1.12.0 → v1.12.1

github.com/psf/black: 21.12b0 → 22.1.0
opened by pre-commit-ci[bot] 1
Additional option for flattening pandas DataFrames
Currently the user can decide between two ways of treating DataFrames

Only the entries in a fixed set of columns appears in the flat list of leaves

All entries appear in the flat list of leaves.

In estimagic a third mode would be very practical that automatically switches between the two cases above. If all columns from the specified subset are present, only those columns are considered. If None of the columns is present, all entries are considered.

If this sounds too special, we can also only add it in estimagic.
opened by janosg 1
Add basic documentation
To-Do

[x] Add all functions that can be directly imported from pybaum to an API Documentation

[ ] Write some text about the rationale behind pybaum

[ ] Explain deviations from JAX

[ ] Add examples

enhancement good first issue
opened by janosg 0
Test against JAX
To-Do

[ ] Write sample_tree function that creates a random pytree based on some high level information

[ ] Create random pytrees and test against JAX

[ ] Test current example pytrees against JAX

Note

Need to find a way of not installing JAX on windows in tox.
enhancement good first issue
opened by janosg 0
Improve treedef
Problem

The JAX treedef contains more information. Therefore, their tree_unflatten function does not need an is_leaf argument. The same way we could make the registry argument unnecessary.

This is not just more convenient. It reduces error potential because the unflattening will automatically use the same options as the flattening.

To-Do

[ ] Come up with better Treedef (namedtuple or Class) and implement it

[ ] Adjust interface of tree_unflatten.

enhancement
opened by janosg 1
Improve error checking
To-Do

[ ] Add explicit error handling to tree_equal

[ ] Check for typos in options and types in get_registry and suggest improvements with fuzzywuzzy

[ ] Look for more places where we need better error handling

enhancement
opened by janosg 0

Releases(v0.1.3)

v0.1.3(Dec 16, 2022)
#22 Improves the type check for jax arrays and enables support for Jax 0.4.1 or newer.

Source code(tar.gz)
Source code(zip)
v0.1.2(Jun 15, 2022)
Add JAX array support to pybaum. By @timmens and @janosg in #18 and #20

Source code(tar.gz)
Source code(zip)
v0.1.1(Feb 19, 2022)
What's Changed

Add a section about the API to the docs. by @tobiasraabe in https://github.com/OpenSourceEconomics/pybaum/pull/12

Add default arguments to tree_just_flatten. by @tobiasraabe in https://github.com/OpenSourceEconomics/pybaum/pull/10

Implement tree_yield and tree_just_yield. by @tobiasraabe in https://github.com/OpenSourceEconomics/pybaum/pull/11

Add badges and a short description to the readme. by @tobiasraabe in https://github.com/OpenSourceEconomics/pybaum/pull/13

Full Changelog: https://github.com/OpenSourceEconomics/pybaum/compare/v0.1.0...v0.1.1
Source code(tar.gz)
Source code(zip)
v0.1.0(Jan 28, 2022)

Source code(tar.gz)
Source code(zip)

Owner

Open Source Economics

A platform for transdisciplinary collaboration in the development, analysis, and application of computational economic models.

GitHub Repository https://pybaum.readthedocs.io

Predicting the duration of arrival delays for commercial flights.

Flight Delay Prediction Our objective is to predict arrival delays of commercial flights. According to the US Department of Transportation, about 21%

1 Jan 11, 2022

mlpack: a scalable C++ machine learning library --

4.2k Jan 09, 2023

A CNN implementation using only numpy. Supports multidimensional images, stride, etc.

A CNN implementation using only numpy. Supports multidimensional images, stride, etc. Speed up due to heavy use of slicing and mathematical simplification..

2 Nov 30, 2021

Puzzle-CAM: Improved localization via matching partial and full features.

Puzzle-CAM The official implementation of "Puzzle-CAM: Improved localization via matching partial and full features".

150 Nov 14, 2022

2021 National Underwater Robotics Vision Optics

2021-National-Underwater-Robotics-Vision-Optics 2021年全国水下机器人算法大赛-光学赛道-B榜精度第18名 (Kilian_Di的团队：A榜[email pro

9 Nov 04, 2022

Randomized Correspondence Algorithm for Structural Image Editing

===================================== README: Inpainting based PatchMatch ===================================== @Author: Younesse ANDAM @Conta

116 Dec 24, 2022

The code release of paper Low-Light Image Enhancement with Normalizing Flow

[AAAI 2022] Low-Light Image Enhancement with Normalizing Flow Paper | Project Page Low-Light Image Enhancement with Normalizing Flow Yufei Wang, Renji

176 Jan 06, 2023

A Home Assistant custom component for Lobe. Lobe is an AI tool that can classify images.

Lobe This is a Home Assistant custom component for Lobe. Lobe is an AI tool that can classify images. This component lets you easily use an exported m

4 Feb 28, 2022

Official Pytorch implementation of "DivCo: Diverse Conditional Image Synthesis via Contrastive Generative Adversarial Network" (CVPR'21)

DivCo: Diverse Conditional Image Synthesis via Contrastive Generative Adversarial Network Pytorch implementation for our DivCo. We propose a simple ye

64 Nov 22, 2022

This repository contains PyTorch code for Robust Vision Transformers.

117 Dec 07, 2022

Consensus score for tripadvisor

ContripScore ContripScore is essentially a score that combines an Internet platform rating and a consensus rating from sentiment analysis (For instanc

1 Jan 13, 2022

🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI

PyTorch implementation of OpenAI's Finetuned Transformer Language Model This is a PyTorch implementation of the TensorFlow code provided with OpenAI's

1.4k Jan 05, 2023

Python and C++ implementation of "MarkerPose: Robust real-time planar target tracking for accurate stereo pose estimation". Accepted at LXCV @ CVPR 2021.

MarkerPose: Robust real-time planar target tracking for accurate stereo pose estimation This is a PyTorch and LibTorch implementation of MarkerPose: a

47 Nov 18, 2022

Yoloxkeypointsegment - An anchor-free version of YOLO, with a simpler design but better performance

Introduction 关键点版本：已完成全景分割版本：已完成实例分割版本：已完成 YOLOX is an anchor-free version of

23 Oct 20, 2022

TensorFlow ROCm port

Documentation TensorFlow is an end-to-end open source platform for machine learning. It has a comprehensive, flexible ecosystem of tools, libraries, a

622 Jan 09, 2023

Good Semi-Supervised Learning That Requires a Bad GAN

Good Semi-Supervised Learning that Requires a Bad GAN This is the code we used in our paper Good Semi-supervised Learning that Requires a Bad GAN Ziha

177 Dec 12, 2022

Keras Implementation of The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation by (Simon Jégou, Michal Drozdzal, David Vazquez, Adriana Romero, Yoshua Bengio)

The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation: Work In Progress, Results can't be replicated yet with the m

196 Aug 30, 2022

pybaum provides tools to work with pytrees which is a concept burrowed from JAX.

Related tags

Overview

pybaum

Installation

About

Comments

Problem

Solution

To-Do

To-Do

Note

Problem

To-Do

To-Do

Releases(v0.1.3)

v0.1.3(Dec 16, 2022)

v0.1.2(Jun 15, 2022)

v0.1.1(Feb 19, 2022)

What's Changed

v0.1.0(Jan 28, 2022)

Owner

Open Source Economics

Predicting the duration of arrival delays for commercial flights.

mlpack: a scalable C++ machine learning library --

A CNN implementation using only numpy. Supports multidimensional images, stride, etc.

Puzzle-CAM: Improved localization via matching partial and full features.

2021 National Underwater Robotics Vision Optics

Randomized Correspondence Algorithm for Structural Image Editing

The code release of paper Low-Light Image Enhancement with Normalizing Flow

A Home Assistant custom component for Lobe. Lobe is an AI tool that can classify images.

Official Pytorch implementation of "DivCo: Diverse Conditional Image Synthesis via Contrastive Generative Adversarial Network" (CVPR'21)

This repository contains PyTorch code for Robust Vision Transformers.

Consensus score for tripadvisor

🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI

Python and C++ implementation of "MarkerPose: Robust real-time planar target tracking for accurate stereo pose estimation". Accepted at LXCV @ CVPR 2021.

Yoloxkeypointsegment - An anchor-free version of YOLO, with a simpler design but better performance

TensorFlow ROCm port

Good Semi-Supervised Learning That Requires a Bad GAN

Keras Implementation of The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation by (Simon Jégou, Michal Drozdzal, David Vazquez, Adriana Romero, Yoshua Bengio)

MPLP: Metapath-Based Label Propagation for Heterogenous Graphs

Official implementation of "Articulation Aware Canonical Surface Mapping"

Turi Create simplifies the development of custom machine learning models.