Popular GitHub Repositories for Kv Cache

Unified KV Cache Compression Methods for Auto-Regressive Models

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)

Completion After Prompt Probability. Make your LLM make a choice

Notes about LLaMA 2 model

Fine-Tuned Mistral 7B Persian Large Language Model LLM / Persian Mistral 7B

Image Captioning With MobileNet-LLaMA 3

Simple and easy to understand PyTorch implementation of Large Language Model (LLM) GPT and LLAMA from scratch with detailed steps. Implemented: Byte-Pair Tokenizer, Rotational Positional Embedding (RoPe), SwishGLU, RMSNorm, Mixture of Experts (MOE). Tested on Taylor Swift song lyrics dataset.

my llama3 implementation

A custom Vision-Language Model (VLM) built from scratch, using SigLip for contrastive learning and a ViT-based encoder to generate meaningful image captions and semantic descriptions.

A custom Vision-Language Model (VLM) built from scratch, using SigLip for contrastive learning and a ViT-based encoder to generate meaningful image captions and semantic descriptions.