BioMedical-NLP-corpus

pix2tex: Using a ViT to convert images of equations into LaTeX code.

A MNIST-like fashion product database. Benchmark :point_down:

Open source annotation tool for machine learning practitioners.

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

Curated list of Machine Learning, NLP, Vision, Recommender Systems Project Ideas

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

A powerful tool for creating fine-tuning datasets for LLM

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

Models, data loaders and abstractions for language processing, powered by PyTorch