AIbase
Product LibraryTool Navigation

shared-azure-openai-tpm

Public

This example shows how a multitenant service can distribute requests evenly among multiple Azure OpenAI Service instances and manage tokens per minute (TPM) for multiple tenants.

Creat2023-11-10T16:23:45
Update2024-10-11T16:18:37
11
Stars
0
Stars Increase

Related projects