LlamaIndex-RAG-Linux-CUDA

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

A high-throughput and memory-efficient inference and serving engine for LLMs

Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory! ?

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

kaldi-asr/kaldi is the official location of the Kaldi project.

SGLang is a fast serving framework for large language models and vision language models.

Open3D: A Modern Library for 3D Data Processing

NumPy aware dynamic Python compiler using LLVM

NumPy & SciPy for GPU

cuDF - GPU DataFrame Library