Popular GitHub Repositories for Language Modelling

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

Contextualised Embeddings and Language Modelling using BERT and Friends using R

Pytorch implementation of MaskGAN

This repository contains code and data download instructions for the workshop paper "Improving Hierarchical Product Classification using Domain-specific Language Modelling" by Alexander Brinkmann and Christian Bizer.

Code for paper: "Numeracy Enhances the Literacy of Language Models"

BERT-based pre-trained non-autoregressive sequence-to-sequence model

This respository contains projects made for the NLP course at the AGH UST in 2024/2025. Obtained maximum grade 5.0.