Popular GitHub Repositories for Preprocessing

中文 NLP 预处理、解析工具包，准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com

Automated Time Series Forecasting

NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.

Audio processing by using pytorch 1D convolution network

:dart: Personal data science and machine learning toolbox

Introduction to time series preprocessing and forecasting in Python using AR, MA, ARMA, ARIMA, SARIMA and Prophet model with forecast evaluation.

[WIP] VoiceSmith makes training text to speech models easy.

Deliver the ready-to-train data to your NLP model.

Python implementation of pre-processing for End-to-End speech recognition

End-to-end Python CT volume preprocessing pipeline to convert raw DICOMs into clean 3D numpy arrays for ML. From paper Draelos et al. "Machine-Learning-Based Multiple Abnormality Prediction with Large-Scale Chest Computed Tomography Volumes."

SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batching, and more. Supports datasets from Huggingface, torchdata iterables, or simple lists of dictionaries.

Document Filters is an SDK for applications like content indexing, e-discovery, data migration, and feeding data into AI/ML models by extracting data from unstructured sources. It gives the ability to perform deep inspection, data extraction, output manipulation, and conversion for virtually any type of document, in any programming language.

Preprocessing and classify EMG signals, using Tensorflow and Tensorflow Lite to deploy an AI model in a ESP32C3

NLPiper is a package that agglomerates different NLP tools and applies their transformations in the target document.

A library that includes Keras 3 preprocessing and augmentation layers, providing support for various data types such as images, labels, bounding boxes, segmentation masks, and more.

This a JavaScript Library for the Numerical Javascript and Machine Learning

Bangla NLP toolkit.

NLP Preprocessing Pipeline Wrappers

LSTM based model for Named Entity Recognition Task using pytorch and GloVe embeddings

Sentiment analysis of the restaurant reviews from YELP dataset using BoW, TF-IDF, Word2Vec, Doc2Vec, Glove and BERT.