AIbase
Product LibraryTool Navigation

batch-inference

Public

Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.

Creat2023-04-17T15:15:38
Update2025-02-27T04:11:37
https://microsoft.github.io/batch-inference/
95
Stars
0
Stars Increase

Related projects