AIbase
Product LibraryTool Navigation

grps

Public

Deep Learning Deployment Framework: Supports tf/torch/trt/trtllm/vllm and other NN frameworks. Support dynamic batching, and streaming modes. It is dual-language compatible with Python and C++, offering scalability, extensibility, and high performance. It helps users quickly deploy models and provide services through HTTP/RPC interfaces.

Creat2024-07-04T20:12:03
Update2025-03-25T19:55:27
https://zhuanlan.zhihu.com/p/707491462
157
Stars
0
Stars Increase