Fast-Spark-TTS

Production ready LLM model compression/quantization toolkit with hw accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

?? Easy, advanced inference platform for large language models on Kubernetes. ? Star to support our work!

A local and uncensored AI entity.

ComfyUI-SparkTTS is a custom ComfyUI node implementation of SparkTTS, an advanced text-to-speech system that harnesses the power of large language models (LLMs) to generate highly accurate and natural-sounding speech.

AI-based search engine done right

A guide to structured generation using constrained decoding

Experiments with LLMs in clouds (powered by SGLang)

DeepSeek-V3, R1 671B on 8xH100 Throughput Benchmarks

Reading notes on the open source code of AI infrastructure --- AI Infra 的开源代码阅读笔记 (LLM, DL, HPC, CUDA, SIMD...)

SgLang vs vLLM Comparison