defi-user-behavior-clustering

Build data pipelines, the easy way ?️

Implementing best practices for PySpark ETL jobs and applications.

A curated list of awesome decentralized finance projects

Enterprise-grade and API-first LLM workspace for unstructured documents, including data extraction, redaction, rights management, prompt playground, and more!

Integrate LLM in any pipeline - fit/predict pattern, JSON driven flows, and built in concurency support.

A simplified, lightweight ETL Framework based on Apache Spark

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

A simple Spark-powered ETL framework that just works ?

Jayvee is a domain-specific language and runtime for automated processing of data pipelines

This is a template you can use for your next data engineering portfolio project.