Popular GitHub Repositories for Scalability

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Machine Learning Engineering Open Book

An open collection of methodologies to help with successful training of large language models.

An open collection of implementation tips, tricks and resources for training large language models

DeepHyper: Scalable Asynchronous Neural Architecture and Hyperparameter Search for Deep Neural Networks

Implementation of "GNNAutoScale: Scalable and Expressive Graph Neural Networks via Historical Embeddings" in PyTorch

[ICLR 2022] Code for Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillation (GLNN)

[ICLR 2023] MLPInit: Embarrassingly Simple GNN Training Acceleration with MLP Initialization

[ICLR 2023] Link Prediction with Non-Contrastive Learning

[ICML 2023] Linkless Link Prediction via Relational Distillation

[SIGMETRICS 2022] One Proxy Device Is Enough for Hardware-Aware Neural Architecture Search

Source code "Unsupervised Model Personalization while Preserving Privacy and Scalability: An Open Problem." @ CVPR2020

CVPR 2020 Workshop on Scalability in Autonomous Driving: GAIS-Net: Geometry-Aware Instance Segmentation with Disparity Maps

Be the CEO of your own AI workforce, efficiently managing countless intelligent agents with minimal resources.

A Multi Agent Based Simulation engine in Julia language

KGpip - A Scalable AutoML Approach Based on Graph Neural Networks

A modular framework for building and deploying Retrieval-Augmented Generation (RAG) systems with built-in evaluation and monitoring.

Deep Learning project for UniMi MSc in Computer Science, courses: Algorithms for massive datasets, Statistical Methods for Machine Learning.

Scaling NLP processing pipelines with Dask and PySpark, utilising Apache Kafka real-time data streaming, for optimal LLM training