AI-900 · Question #349
You plan to create an AI application that will use Azure OpenAI Service. The solution requires that a specific amount of throughput be allocated. Which type of deployment should you use?
The correct answer is B. provisioned. When a specific amount of throughput is needed with Azure OpenAI Service, you should use Provisioned Throughput Units (PTUs) for your deployment. PTUs allow you to reserve a fixed amount of processing capacity for your models, ensuring consistent performance and avoiding…
Question
Options
- Aglobal batch
- Bprovisioned
- Cdata zone standard
- Dstandard
How the community answered
(15 responses)- A7% (1)
- B87% (13)
- C7% (1)
Explanation
When a specific amount of throughput is needed with Azure OpenAI Service, you should use Provisioned Throughput Units (PTUs) for your deployment. PTUs allow you to reserve a fixed amount of processing capacity for your models, ensuring consistent performance and avoiding potential throttling or rate limits. In contrast, the "Standard" deployment option in Azure OpenAI Service uses a "pay-as-you-go" model, where you are billed for the amount of usage. While this can be suitable for applications with fluctuating usage patterns, it does not provide the same level of throughput control as PTUs. In summary: When you need to allocate a specific amount of throughput with Azure OpenAI Service, choose the "Provisioned" deployment type, which allows you to use PTUs. https://github.com/MicrosoftDocs/azure-ai-docs/blob/main/articles/ai- services/openai/concepts/provisioned-throughput.md
Topics
Community Discussion
No community discussion yet for this question.