BioMedical-NLP-corpus

pix2tex: Using a ViT to convert images of equations into LaTeX code.

A MNIST-like fashion product database. Benchmark :point_down:

Open source annotation tool for machine learning practitioners.

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

Curated list of Machine Learning, NLP, Vision, Recommender Systems Project Ideas

A powerful tool for creating fine-tuning datasets for LLM

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

Models, data loaders and abstractions for language processing, powered by PyTorch