AIKit

A one-stop solution for hosting, deploying, building, and fine-tuning open-source large language models.

CommonProductProgrammingOpen-sourceLarge Language Models

AIKit is an open-source tool designed to simplify the process of hosting, deploying, building, and fine-tuning large language models (LLMs). It offers a REST API compatible with the OpenAI API, supporting various inference capabilities and formats, allowing users to send requests using any compatible client. Furthermore, AIKit provides an extensible fine-tuning interface with Unsloth support, offering users a fast, memory-efficient, and user-friendly fine-tuning experience.

Wide-ranging inference capabilities through LocalAI
compatible with OpenAI API.
Extensible fine-tuning interface with Unsloth support.
Runs effortlessly on Docker without requiring GPUs
internet access
or additional tools.
Minimized image size
reducing vulnerabilities and attack surface.
Supports declarative configuration
simplifying inference and fine-tuning processes.

AIKit is suitable for developers
data scientists
and machine learning engineers who need a simple
efficient
and cost-effective way to deploy and fine-tune large language models. It provides robust support whether you're running it on a local machine or in a cloud environment.

Quickly start LLMs on a local machine with AIKit without needing a GPU.
Deploy LLMs on Kubernetes with AIKit for automated deployment and management.
Fine-tune models on specific domain data using AIKit's fine-tuning capabilities.

1. Install Docker to run AIKit.
2. Clone the AIKit repository from GitHub or use the pre-built Docker image.
3. Configure AIKit's inference and fine-tuning parameters as needed.
4. Start the AIKit service using Docker commands.
5. Send requests using an OpenAI-compatible API client.

Visit

AIKit Visit Over Time

Monthly Visits

515580771

Bounce Rate

37.20%

Page per Visit

5.8

Visit Duration

00:06:42

AIKit Visit Trend

AIKit Visit Geography

AIKit Traffic Sources

AIKit Alternatives

Open-Source Large Model Cookbook — A tutorial for quickly deploying open-source large models on a Linux environment

Programming•Large Models•Open-Source

1458

Finetune — A platform for fine-tuning AI intelligent agents.

InternationalSelection•Intelligent Agents•Fine-tuning

Expert Specialized Fine-Tuning — A professional fine-tuning tool for customizing large language models.

Programming•Large Language Models•Fine-Tuning

OpenVLA — An open-source vision-language-action (VLA) model that drives the development of robotics operation technologies.

Productivity•Robotics•Artificial Intelligence

312

MarkLLM — An open-source toolkit for the research and application of large language model watermarking technology.

Programming•Open-source•Watermarking

234

DeployFast — AI packaging deployment, completed in minutes

Productivity•Artificial Intelligence•Deployment

204

OpenCopilot — Effortlessly build and integrate your own open-source AI partner.

Productivity•AI Partner•Open-Source

162

Qwen2.5-Coder-3B — The 3B parameter model in the Qwen2.5-Coder series focuses on code generation and comprehension.

Programming•Code Generation•Code Reasoning

TableGPT2 — A large multimodal model that integrates tabular data.

Productivity•Multimodal Model•Tabular Data

Agora — A cross-platform communication protocol that enables efficient communication between different large language models (LLMs).

Programming•Communication Protocol•Large Language Models

5ire — User-friendly and unlocks the immense power of AI

Productivity•Large Language Models•Open Source

O1-Journey — O1 Journey: Strategic Progress Report Part One

Programming•Artificial Intelligence•Machine Learning

URL Parser Online — An online URL parser that converts URLs into a format suitable for large language models.

Productivity•URL Parsing•Data Extraction

270

SELA — SELA enhances automated machine learning by combining Monte Carlo Tree Search and LLM-based agents.

Programming•Automated Machine Learning•Monte Carlo Tree Search

LongVU — Spatiotemporal Adaptation Compression Model for Long Video Language Understanding

Video•Video Understanding•Spatiotemporal Compression

SiYuan — Privacy-focused, self-hosted, fully open-source personal knowledge management system

Productivity•Electronic notes•Knowledge management

FaceFusion Labs — Industry-leading facial manipulation platform

Image•Facial Manipulation•Facial Recognition

198

awesome-LLM-resources — A comprehensive collection of global large language model resources.

Productivity•Large Language Models•Resource Aggregation

VirtualWife — A virtual digital human project that supports live streaming on Bilibili.

chatting•Virtual Digital Human•Emotional Companionship

108

MM1.5 — Optimization and analysis of multimodal large language models

Productivity•Multimodal•Large Language Models

AutoDAN-Turbo — An automated framework for breaking the limitations of large language models

Programming•Automation•Jailbreaking

AutoArena — Automated Generative AI Assessment Platform

Programming•AI Assessment•Automation

Lumigator — AI Model Selection Assistant

Productivity•Large Language Models•Model Selection

Tilores Identity RAG — Customer Data Unification and Retrieval Platform

Business•Customer Data•Large Language Models

Mermaid Whiteboard — The ultimate AI, Mermaid, and visualization charting suite

Productivity•Charting•Text-driven

Best AI Websites & Tools