Popular GitHub Repositories for Candle

Instant, controllable, local pre-trained AI models in Rust

A comprehensive Rust translation of the code from Sebastian Raschka's Build an LLM from Scratch book.

Low rank adaptation (LoRA) for Candle.

An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Wasm) frontend packaged with Tauri!

Offline real-time captioning software written in Flutter and Rust, powered by Whisper and LLM.

Rust LLM Stream Analyzer and Content Generator

RWKV models and examples powered by candle.

Use HuggingFace's Candle with Go.

ChatFlameBackend is an innovative backend solution for chat applications, leveraging the power of the Candle AI framework with a focus on the Mistral model

Simple LLM Rest API using Rust, Warp and Candle. Dedicated for quantized version of either phi-2 ( default) , Mistral, or Llama. Work using CPU or CUDA

A lightweight Rust application to test interaction with large language models. Currently supports running GGUF quantized models with hardware acceleration.

A minimalistic demo on semantic search based on Rust ecosystem (pipeline)