ollama-batch-cluster

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

The fastai deep learning library

Open deep learning compiler stack for cpu, gpu and specialized accelerators

Open3D: A Modern Library for 3D Data Processing

NumPy & SciPy for GPU

An open-source, low-code machine learning library in Python

cuDF - GPU DataFrame Library

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.