Popular GitHub Repositories for Transformer Xl

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Clean baseline implementation of PPO using an episodic TransformerXL memory

XLNet for generating language.

Challenging Memory-based Deep Reinforcement Learning Agents

custom cuda kernel for {2, 3}d relative attention with pytorch wrapper

Music and text generation with Transformer-XL.

[ACL‘20] Highway Transformer: A Gated Transformer.

2020 阿里云天池大数据竞赛-中医药文献问题生成挑战赛

Fair quantitative comparison of NLP embeddings from GloVe to RoBERTa with Sequential Bayesian Optimization fine-tuning using Flair and SentEval. Extension of HyperOpt library to log_b priors.

Symbolic music generation taking inspiration from NLP and human composition process

Absolutely fantastic and fully working SOTA Transformer-XL Music AI implementation MahlerNet by Elias Lousseief

A Julia-based implementation of XLNet: A Generalized Autoregressive Pretraining for Language Understanding. < Flux | JuliaText >