Popular GitHub Repositories for Transformer

??? 60+ Implementations/tutorials of deep learning papers with side-by-side notes ?; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ? reinforcement learning (ppo, dqn), capsnet, distillation, ... ?

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

A high-throughput and memory-efficient inference and serving engine for LLMs

Port of OpenAI's Whisper model in C/C++

SOTA Open Source TTS

? A ranked list of awesome machine learning Python libraries. Updated weekly.

Natural Language Processing Tutorial for Deep Learning Researchers

pix2tex: Using a ViT to convert images of equations into LaTeX code.

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

SGLang is a fast serving framework for large language models and vision language models.

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/README.md)

Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.

OpenMMLab Semantic Segmentation Toolbox and Benchmark.

A framework for few-shot evaluation of language models.

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

Trax — Deep Learning with Clear Code and Speed

Code for the paper "Jukebox: A Generative Model for Music"

Chinese version of GPT2 training code, using BERT tokenizer.

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

Google AI 2018 BERT pytorch implementation