From July 1, 2024, Microsoft expands purchasing options in Azure OpenAI to include the Provisioned Throughput Unit (PTU) offer. PTU is a provisioned-capacity offer that provides consistent latency for uniform workloads. This is available through SCHNEIDER IT MANAGEMENT as your Cloud Solution Provider (CSP), and also introduces a new monthly reservation commitment option.
Purchasing Options of Azure OpenAI: PAYG and PTU
Microsoft Azure OpenAI model inferencing models are AI models, such as GPT-4, GPT-3.5, DALL-E, and Whisper, available through Azure OpenAI services. Microsoft Azure OpenAI model inferencing models can be purchased in two ways:
- Pay-as-you-go: Charged on a per-token
- Provisioned Throughput (PTU): Offers consistent latency for uniform workloads, ideal for scaling AI solutions.
What is Provisioned Throughput (PTU)?
Provisioned Throughput (PTU) is a new purchasing model for Azure OpenAI services where customers can reserve a specific amount of processing capacity.
Benefits of Provisioned Throughput (PTU)
- Predictable Performance: PTU offers a stable maximum latency and throughput for uniform workloads, meaning you get a fixed speed and performance for your tasks.
- Reserved Processing Capacity: Throughput is available whether used or not.
- Cost Savings: For tasks that need a lot of processing, PTU can be cheaper than paying for each use (token-based consumption).
Payment Options of Provisioned Throughput (PTU)
Provisioned Throughput (PTU) offers flexible payment options to suit different needs:
- Hourly Payments: Pay for the processing power you use each hour.
- Monthly or Yearly Reservations: Get discounts by committing to a 1-month or 1-year term.
- Combination: Mix hourly payments with reservation discounts.
More information
Find the announcement: https://learn.microsoft.com/en-us/partner-center/announcements/2024-july#3.
For more info on Azure OpenAI Services, please visit: https://learn.microsoft.com/en-us/azure/ai-services/openai/overview.
Visit the Azure OpenAI Studio: https://oai.azure.com/portal.
For more on Microsoft licensing, visit our Microsoft vendor page at: https://www.schneider.im/software/microsoft/.
Please contact us for expert services on your specific Microsoft software and Online Services requirements and to request a quote today.