Popular GitHub Repositories for Candle

Instant, controllable, local pre-trained AI models in Rust

A comprehensive Rust translation of the code from Sebastian Raschka's Build an LLM from Scratch book.

Low rank adaptation (LoRA) for Candle.

An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Wasm) frontend packaged with Tauri!

Offline real-time captioning software written in Flutter and Rust, powered by Whisper and LLM.

Rust LLM Stream Analyzer and Content Generator

RWKV models and examples powered by candle.

Use HuggingFace's Candle with Go.

Fullstack chatbot built using Rust. Made using Candle, Leptos, Actix, Tokio and Tailwind. Uses quantized Mistral 7B Instruct v0.1 GGUF models.

ChatFlameBackend is an innovative backend solution for chat applications, leveraging the power of the Candle AI framework with a focus on the Mistral model

Simple LLM Rest API using Rust, Warp and Candle. Dedicated for quantized version of either phi-2 ( default) , Mistral, or Llama. Work using CPU or CUDA

A lightweight Rust application to test interaction with large language models. Currently supports running GGUF quantized models with hardware acceleration.

A minimalistic demo on semantic search based on Rust ecosystem (pipeline)

Dartion是一个命令行界面服务器，用于运行Danbooru标签转换模型。