DVARS

Making large AI models cheaper, faster and more accessible

ClickHouse? is a real-time analytics database management system

Port of OpenAI's Whisper model in C/C++

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

Hastic python core for processing machine learning tasks. Could be used separately.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

大数据入门指南 :star:

SGLang is a fast serving framework for large language models and vision language models.