Popular GitHub Repositories for Nlp Machine Learning

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

ChatGPT带火了聊天机器人，主流的趋势都调整到了GPT类模式，本项目也与时俱进，会在近期更新GPT类版本。基于本项目和自己的语料可以训练出自己想要的聊天机器人，用于智能客服、在线问答、闲聊等场景。

The most accurate natural language detection library for Go, suitable for short text and mixed-language text

A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).

A deep dive into embeddings starting from fundamentals

Rasa UI is a frontend for the Rasa Framework

The most accurate natural language detection library for Rust, suitable for short text and mixed-language text

skweak: A software toolkit for weak supervision applied to NLP tasks

We introduced a new model designed for the Code generation task. Its test accuracy on the HumanEval base dataset surpasses that of GPT-4 Turbo (April 2024) and GPT-4o.

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

BabyAI platform. A testbed for training agents to understand and execute language commands.

Grounded search engine (i.e. with source reference) based on LLM / ChatGPT / OpenAI API. It supports web search, file content search etc.

SpaCy 中文模型 | Models for SpaCy that support Chinese

Converse with book - Built with GPT-3

Resources for learning about Text Mining and Natural Language Processing

The hands-on NLTK tutorial for NLP in Python

Precision Medicine Knowledge Graph (PrimeKG)

Compendium of the resources available from top NLP conferences.

基于在线民宿 UGC 数据的意见挖掘项目，包含数据挖掘和NLP 相关的处理，负责数据采集、主题抽取、情感分析等任务。目的是克服用户打分和评论不一致，实时对在线民宿的满意度评测，包含在线评论采集和情感可视化分析。搭建了百度地图POI查询入口，可以进行自动化的批量查询 POI 信息的功能；构建了基于在线民宿语料的 LDA 自动主题聚类模型，利用主题中心词能找出对应的主题属性字典；以用户打分作为标注，然后 litNlp 自带的字符级 TextCNN 进行情感分析，将情感分类概率分布作为情感趋势，最后通过 POI 热力图的方式对不同地域的民宿满意度进行展示。软件版本请见链接。

Hierarchical Attention Networks for document classification