AIbase
Product LibraryTool Navigation

swiftLLM

Public

A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).

Creat2024-05-11T14:23:06
Update2025-03-26T20:53:46
156
Stars
0
Stars Increase

Related projects