dash-infer

A high-throughput and memory-efficient inference and serving engine for LLMs

kaldi-asr/kaldi is the official location of the Kaldi project.

SGLang is a fast serving framework for large language models and vision language models.

Open3D: A Modern Library for 3D Data Processing

NumPy aware dynamic Python compiler using LLVM

NumPy & SciPy for GPU

cuDF - GPU DataFrame Library

Containers for machine learning

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.