SOFT

《李宏毅深度学习教程》（李宏毅老师推荐?，苹果书?），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

The GitHub repository for the paper "Informer" accepted by AAAI 2021.

Graph Attention Networks (https://arxiv.org/abs/1710.10903)

Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)

Implementation for MatMul-free LM.

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

The implementation of DeBERTa

Recent Transformer-based CV and related works.

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.