whisper-cpp-server

Making large AI models cheaper, faster and more accessible

Port of OpenAI's Whisper model in C/C++

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

SGLang is a fast serving framework for large language models and vision language models.

Machine Learning Engineering Open Book

? The exhaustive Pattern Matching library for TypeScript, with smart type inference.

NVIDIA? TensorRT? is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.