Popular GitHub Repositories for Gpt2

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

中文nlp解决方案(大模型、数据、模型、训练、推理)

GPT2 for Chinese chitchat/用于中文闲聊的GPT2模型(实现了DialoGPT的MMI思想)

RoBERTa中文预训练模型: RoBERTa for Chinese

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Human ChatGPT Comparison Corpus (HC3), Detectors, and more! ?

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。

Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation

TextGen: Implementation of Text Generation models, include LLaMA, BLOOM, GPT2, BART, T5, SongNet and so on. 文本生成模型，实现了包括LLaMA，ChatGLM，BLOOM，GPT2，Seq2Seq，BART，T5，UDA等模型的训练和预测，开箱即用。

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Pre-trained Transformers for Arabic Language Understanding and Generation (Arabic BERT, Arabic GPT2, Arabic ELECTRA)

Code for producing Japanese pretrained models provided by rinna Co., Ltd.

MindSpore online courses: Step into LLM

Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

1. Use BERT, ALBERT and GPT2 as tensorflow2.0's layer. 2. Implement GCN, GAN, GIN and GraphSAGE based on message passing.

One-click training of your own GPT. Training a GPT has never been easier. / 训练一个GPT原来可以这么简单？

????2? ?????? ???? ????? (???????? BERT? GPT3??) ????

OpenAI GPT2 pre-training and sequence prediction implementation in Tensorflow 2.0

Easy and Efficient Transformer : Scalable Inference Solution For Large NLP model