Popular GitHub Repositories for Llamacpp Python

基于SparkTTS模型，提供高质量中文语音合成与声音克隆服务。

A local and uncensored AI entity.

Dolphin 3.0 ?: Versatile AI for coding, math, and more

A simple repository demonstrating LlamaCPP yielding structured output

SmolLM2 ?: Family of lightweight language models, performs diverse tasks on-device

TinySwallow: TAID distillation boosts instruction following

This repository demonstrates how to use outlines and llama-cpp-python for structured JSON generation with streaming output, integrating llama.cpp for local model inference and outlines for schema-based text generation.

FastAPI semantic search + custom entity detection platform.

Qwen2.5-Coder: Family of LLMs excels in code, debugging, etc

Setting up a local inference environment with llama.cpp and pytorch, with CUDA support . Using huggingface transformers and outlines for structured generation.