AIbase
Product LibraryTool Navigation

inference

Public

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

Creat2023-06-14T15:05:04
Update2024-12-15T12:49:05
https://inference.readthedocs.io
1.6K
Stars
-5723
Stars Increase