Popular GitHub Repositories for Parquet

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

?? RumbleDB 1.22.0 "Pyrenean oak" ? for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

Generate massive fake datasets for your datalake, fast. By SOMA

A real-time data cleaning pipeline for medical and healthcare data using Apache Spark, SparkNLP, Spark Streaming, and Kafka.

Supercharge Your Compute for Analytics & AI

Icebird: JavaScript Iceberg Client

Edge to AI: IoT