Popular GitHub Repositories for Cpu Inference

Runs LLaMA with Extremely HIGH speed

LLM inference in Fortran

Portable LLM - A rust library for LLM inference

Wrapper for simplified use of Llama2 GGUF quantized models.

Simple large language model playground app

V-lang api wrapper for llm-inference chatllm.cpp

VB.NET api wrapper for llm-inference chatllm.cpp

C# api wrapper for llm-inference chatllm.cpp

Nim api-wrapper for llm-inference chatllm.cpp

Simple bot that transcribes Telegram voice messages. Powered by go-telegram-bot-api & whisper.cpp Go bindings.

kotlin api wrapper for llm-inference chatllm.cpp

D-lang api wrapper for llm-inference chatllm.cpp

rust api wrapper for llm-inference chatllm.cpp

lua api wrapper for llm-inference chatllm.cpp