speechT

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

Universal LLM Deployment Engine with ML Compilation

DocsGPT is an open-source genAI tool that helps users get reliable answers from knowledge source, while avoiding hallucinations. It enables private and reliable information retrieval, with tooling and agentic system capability built in.

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

An open source implementation of CLIP.