SHAN

深度学习经典、新论文逐段精读

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

This repository is no longer maintained.

Natural Language Processing Tutorial for Deep Learning Researchers

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

? Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.???

Code for the paper "Jukebox: A Generative Model for Music"

记录每天整理的计算机视觉/深度学习/机器学习相关方向的论文

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

A collection of AWESOME things about domian adaptation