Popular GitHub Repositories for Nlp Library

fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.

中文自然语言处理工具包 Toolkit for Chinese natural language processing

:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

Underthesea - Vietnamese NLP Toolkit

A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).

Thai natural language processing in Python

A plug-and-play library for parameter-efficient-tuning (Delta Tuning)

skweak: A software toolkit for weak supervision applied to NLP tasks

Easy-to-use and high-performance NLP and LLM framework based on MindSpore, compatible with models and datasets of ?Huggingface.

A curated list of resources dedicated to Python libraries, LLMs, dictionaries, and corpora of NLP for Japanese

Library for clinical NLP with spaCy.

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

A Japanese tokenizer based on recurrent neural networks

chatbot_ner: Named Entity Recognition for chatbots.

An NLP library for the Urdu language. It comes with a lot of battery included features to help you process Urdu data in the easiest way possible.

Pytorch NLP library based on FastAI

DaNLP is a repository for Natural Language Processing resources for the Danish Language.

WEFE: The Word Embeddings Fairness Evaluation Framework. WEFE is a framework that standardizes the bias measurement and mitigation in Word Embeddings models. Please feel welcome to open an issue in case you have any questions or a pull request if you want to contribute to the project!

A library to synthesize text datasets using Large Language Models (LLM)

Library of state-of-the-art models (PyTorch) for NLP tasks