Visual-Attention-Model

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

? GPU accelerated Neural networks in JavaScript for Browsers and Node.js

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)

VIP cheatsheets for Stanford's CS 230 Deep Learning

Setup and customize deep learning environment in seconds.

A flexible framework of neural networks for deep learning

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

A concise but complete full-attention transformer with a set of promising experimental features from various papers

This repo contains the source code in my personal column (https://zhuanlan.zhihu.com/zhaoyeyu), implemented using Python 3.6. Including Natural Language Processing and Computer Vision projects, such as text generation, machine translation, deep convolution GAN and other actual combat code.