On September 24, 2024, Microsoft announced the introduction of Data Zones in the Azure OpenAI Service. The new Azure Data Zones deployment type will be available in the coming month. This new feature enhances data processing and storage options, providing customers with more flexibility and control.
What is Azure OpenAI Service?
Azure OpenAI Service is a cloud-based platform that offers advanced AI models for various applications. It allows businesses to integrate AI capabilities into their operations, improving efficiency and innovation.
Enterprises rely on Azure for data privacy and data residency
You can set your data to be hosted only in the EU or the US. This is one of the main features of the new Azure OpenAI Data Zones. However, if you want to host specifically in one country (e.g. Germany), that would be a regional deployment. Here are the differences:
Global Deployment: Available in over 25 regions, this option offers access to all new models at the lowest price with the highest throughputs. Data is stored at rest within the customer selected region of the Azure resource, while the global backbone ensures optimized response times.
Data Zones Deployment: Introducing Data Zones for customers who need greater data processing assurances while accessing the latest models, combined with the flexibility of cross region load balancing within the customer selected geographic boundary. The European Union Data Zone spans all Azure OpenAI regions located within the European Union member states. The United States Data Zone spans all Azure OpenAI regions within the United States. This offers flexibility and higher throughput rates as data processing is distributed across multiple regions.
The new Azure Data Zones deployment type will be available in the coming month.
Regional Deployment: Your data is processed and stored exclusively in the selected region (e.g., Germany). This provides the strictest control over your data but with limited model availability and potentially lower throughput rates.
What are Data Zones?
Data Processing and Storage: In Data Zones, your data is processed and stored in various regions within the chosen geographical boundary (e.g., EU or USA). This means the data is secured across multiple regions within this zone.
Flexibility and Throughput: Data Zones offer the ability to balance loads between different regions within the zone, leading to better performance and higher throughput rates.
Azure Workloads including OpenAI Model Requests in Multiple Zones
Azure OpenAI Data Zones: These are specifically designed for OpenAI models and offer improved data processing and storage within certain geographical boundaries (e.g., EU or USA). This means you can benefit from regional data processing while ensuring your data stays within the chosen zone.
Existing Azure Features: Azure already had the capability to store data in multiple regions, but the new Data Zones provide additional flexibility and performance improvements specifically for OpenAI models.
Licensing
Azure OpenAI Service is available through various licensing options, tailored to meet the needs of different organizations. Customers can choose plans based on their usage and requirements. You can rely on SCHNEIDER IT MANAGEMENT’s expert services to find the best licensing scenario for you.
FAQ
What are Data Zones?
Data Zones are specific areas within Azure where data is processed and stored, offering more control over data residency.
How do Data Zones improve performance?
They enhance throughput and model availability by optimizing data processing.
Can I choose the region for my Data Zone?
Yes, customers can select from Global, Data Zone, and Regional deployments.
More information
You can find the official Microsoft announcement here: https://azure.microsoft.com/en-us/blog/enterprise-trust-in-azure-openai-service-strengthened-with-data-zones/.
There is also a Microsoft Azure OpenAI Service Provisioned offering available: https://azure.microsoft.com/en-us/blog/accelerate-scale-with-azure-openai-service-provisioned-offering/.
For our Microsoft page, please visit: https://www.schneider.im/software/microsoft.
Please contact us for expert services on your specific Microsoft software and online services requirements and to request a quote today.