Storage-for-AI-Paper

data load tool (dlt) is an open source Python library that makes data loading easy ?️

Prepping tables for machine learning

Data Preparation for Satellite Machine Learning

Orbax provides common checkpointing and persistence utilities for JAX users

An open source book to learn data science, data analysis and machine learning, suitable for all ages!

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

A library for incremental loading of large PyTorch checkpoints

“Data science” is just about as broad of a term as they come. It may be easiest to describe what it is by listing its more concrete components: Data exploration & analysis. Included here: Pandas; NumPy; SciPy; a helping hand from Python's Standard Library.

A library for creating and curating reproducible pipelines for scientific and industrial machine learning

High-performance Python librarys for connecting AI/ML frameworks with OSS storage.