Awesome-Efficient-ViT

A PyTorch implementation of the Transformer model in "Attention is All You Need".

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

[TMLR 2024] Efficient Large Language Models: A Survey

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

list of efficient attention modules

Efficient Deep Learning Systems course materials (HSE, YSDA)

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

Open-Source Toolkit for End-to-End Korean Automatic Speech Recognition leveraging PyTorch and Hydra.

A Benchmark of Text Classification in PyTorch

Code and resources on scalable and efficient Graph Neural Networks (TNNLS 2023)