Popular GitHub Repositories for Training Data

A system for quickly generating training data with weak supervision

The AI Datastore for Schemas, BLOBs, and Predictions. Use with your apps or integrate built-in Human Supervision, Data Workflow, and UI Catalog to get the most value out of your AI Data.

Synthetic data generators for tabular and time-series data

skweak: A software toolkit for weak supervision applied to NLP tasks

Computer vision based ML training data generation tool :rocket:

A machine learning tool for automated prediction engineering. It allows you to easily structure prediction problems and generate labels for supervised learning.

Augmenty is an augmentation library based on spaCy for augmenting texts.

Natural Language Data Augmentation Tool for Conversational Systems

SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 languages, generated using PaLM 2 and summarize-then-ask prompting.

COVID-19 Coughs files for training AI models

A command line interface to combine text information from subtitles with voice data in the video. Provides a convenient way to generate training data for speech-recognition purposes.

python script to download & process data to train a speech-synthesis model of Vietnamese M.C. Nguy?n Ng?c Ng?n

Development of a starter dataset for Security Force Monitor NLP projects

A tool for generating diverse synthetic training images using Bing Image Creator to facilitate the training of AI/ML image models.

Python script to transform a set of localization .json files into a .jsonl file for LLM fine-tuning.

Chess engine powered by neural networks featuring web and desktop interfaces, training capabilities, and grandmaster opening support.

Updated version of OpenAI's Grade School Math dataset.