Popular GitHub Repositories for Optax

Repository of Jupyter notebook tutorials for teaching the Deep Learning Course at the University of Amsterdam (MSc AI), Fall 2023

The purpose of this repo is to make it easy to get started with JAX, Flax, and Haiku. It contains my "Machine Learning with JAX" series of tutorials (YouTube videos and Jupyter Notebooks) as well as the content I found useful while learning about the JAX ecosystem.

This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.

Experiment with diffusion models that you can run on your local jupyter instances

Implementation of PSGD optimizer in JAX

Simple CIFAR10 ResNet example with JAX.

Tensor Networks for Machine Learning

Maximal Update Parametrization (μP) with Flax & Optax.

H-Former is a VAE for generating in-between fonts (or combining fonts). Its encoder uses a Point net and transformer to compute a code vector of glyph. Its decoder is composed of multiple independent decoders which act on a code vector to reconstruct a point cloud representing a glpyh.

JAX implementation of Classical and Quantum Algorithms for Orthogonal Neural Networks by (Kerenidis et al., 2021)

A Simplistic trainer for Flax

An implementation of adan optimizer for optax

Training methodologies for autoregressive neural operators/emulators in JAX.

Variational Graph Autoencoder implemented using Jax & Jraph

An Optax-based JAX implementation of the IVON optimizer for large-scale VI training of NNs (ICML'24 spotlight)

dm-haiku implementation of hyperbolic neural networks

Direct port of TD3_BC to JAX using Haiku and optax.

Sophia optimizer with ScheduleFree

Oxford MSc thesis. PriorVAE with graph convolutional networks for learning locally-aware spatial prior distributions

sophia optimizer further projected towards flat areas of loss landscape