Popular GitHub Repositories for Parquet

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

GigAPI：基于DuckDB的Parquet存储引擎和OLAP数据池

?? RumbleDB 1.22.0 "Pyrenean oak" ? for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

用于可视化和分析 Parquet 文件的交互式 Python 命令行界面

Generate massive fake datasets for your datalake, fast. By SOMA

A real-time data cleaning pipeline for medical and healthcare data using Apache Spark, SparkNLP, Spark Streaming, and Kafka.

Supercharge Your Compute for Analytics & AI

Icebird: JavaScript Iceberg Client

将你的音频文件转换成 DuckDB 或 Parquet 文件

Edge to AI: IoT