swiftLLM
PublicA tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).
Creat：2024-05-11T14:23:06
Update：2025-03-26T20:53:46
162
Stars
2
Stars Increase
A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).