Popular GitHub Repositories for Language Modeling

A modular RL library to fine-tune language models to human preferences

The most accurate natural language detection library for Go, suitable for short text and mixed-language text

Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.

Keras implementation of BERT with pre-trained weights

Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

[NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation

Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"

A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"

An Extensible Continual Learning Framework Focused on Language Models (LMs)

An implementation of DeepMind's Relational Recurrent Neural Networks (NeurIPS 2018) in PyTorch.

Curso práctico: NLP de cero a cien ?

XLNet for generating language.

Lyrics Generator aka Character-level Language Modeling with Multi-layer LSTM Recurrent Neural Network

Independently Recurrent Neural Networks (IndRNN) implemented in pytorch.

Comparatively fine-tuning pretrained BERT models on downstream, text classification tasks with different architectural configurations in PyTorch.

Neural Networks for Protein Sequence Alignment

基于 Tensorflow，仿 Scikit-Learn 设计的深度学习自然语言处理框架。支持 40 余种模型类，涵盖语言模型、文本分类、NER、MRC、知识蒸馏等各个领域

Training an n-gram based Language Model using KenLM toolkit for Deep Speech 2

Full finetuning of large language models without large memory requirements

Pre-training of Language Models for Language Understanding