Infini-Attention

??? 60+ Implementations/tutorials of deep learning papers with side-by-side notes ?; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ? reinforcement learning (ppo, dqn), capsnet, distillation, ... ?

whiteboard SDK / infinite canvas SDK

Natural Language Processing Tutorial for Deep Learning Researchers

? Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.???

A PyTorch implementation of the Transformer model in "Attention is All You Need".

My personal implementation of the model from "Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities", they haven't released model code yet sooo...

Experiments with Deep Learning for generating music

该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记

Scenic: A Jax Library for Computer Vision Research and Beyond

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!