Azure Service Operator Version

Oct 13, 2025 by pinkandtrash.com 5 views

## Describe the Bug

The Azure Service Operator (ASO) is a powerful tool for managing Azure resources within Kubernetes environments. However, it currently lacks support for provisioning Azure OpenAI resources and Deployment Models, which is a significant limitation for organizations looking to leverage OpenAI services in their applications. This bug prevents users from managing OpenAI services via Kubernetes, hindering the adoption of a GitOps approach for deploying and managing these resources efficiently.

Azure Service Operator Version: ASOv2

🔹 Description

Azure Service Operator (ASO) currently does not support provisioning Azure OpenAI resources (Microsoft.CognitiveServices/accounts) and Deployment Models (Microsoft.CognitiveServices/accounts/deployments). This feature is essential for managing OpenAI workloads via Kubernetes. The lack of support for these resources makes it challenging for users to deploy and manage OpenAI services within their Kubernetes environments.

🔹 Expected Behavior

ASO should provide a Custom Resource Definition (CRD) for "Microsoft.CognitiveServices/accounts" and "Microsoft.CognitiveServices/accounts/deployments". This would enable users to deploy and manage OpenAI resources through Kubernetes manifests. The CRD would provide a standardized way of defining and managing OpenAI resources, making it easier for users to adopt a GitOps approach for deploying and managing these resources.

🔹 Current Behavior

Attempting to apply a Kubernetes manifest for OpenAI resources results in "Unknown resource type" errors. This indicates that the ASO is not able to recognize the OpenAI resource types, preventing users from deploying and managing these resources. Furthermore, there is no ASO documentation available for Microsoft.CognitiveServices/accounts and Microsoft.CognitiveServices/accounts/deployments, making it difficult for users to understand how to use these resources within their Kubernetes environments.

🔹 Steps to Reproduce

To reproduce this issue, follow these steps:

Create a Kubernetes manifest for an OpenAI resource (e.g., Microsoft.CognitiveServices/accounts).
Attempt to apply the manifest to your Kubernetes cluster using the ASO.
Observe the "Unknown resource type" error.

🔹 Additional Context

The lack of support for OpenAI resources and Deployment Models in ASO is a significant limitation for organizations looking to leverage OpenAI services in their applications. This bug prevents users from managing OpenAI services via Kubernetes, hindering the adoption of a GitOps approach for deploying and managing these resources efficiently. Adding a Custom Resource Definition (CRD) for OpenAI would enable seamless deployment and lifecycle management through ASO.

🔹 Impact

The impact of this bug is significant, as it prevents users from managing OpenAI services via Kubernetes. This makes it challenging for organizations to adopt a GitOps approach for deploying and managing OpenAI resources, which can lead to increased costs, reduced efficiency, and decreased agility.

🔹 Workaround

There is no known workaround for this issue. However, users can consider using alternative tools or services to manage OpenAI resources, such as Azure CLI or Azure Portal.

🔹 Solution

To resolve this issue, the ASO team should add support for provisioning Azure OpenAI resources and Deployment Models. This can be achieved by creating a Custom Resource Definition (CRD) for "Microsoft.CognitiveServices/accounts" and "Microsoft.CognitiveServices/accounts/deployments". This would enable users to deploy and manage OpenAI resources through Kubernetes manifests, making it easier for organizations to adopt a GitOps approach for deploying and managing these resources.

🔹 Conclusion

🔹 Future Work

In the future, the ASO team should consider adding support for other Azure services, such as Azure Machine Learning and Azure Databricks. This would enable users to manage a wider range of Azure resources within their Kubernetes environments, making it easier for organizations to adopt a GitOps approach for deploying and managing these resources.

🔹 References

Azure Service Operator (ASO) documentation: https://docs.microsoft.com/en-us/azure/aks/operator-features
Custom Resource Definitions (CRDs) documentation: https://kubernetes.io/docs/concepts/api-extension/custom-resources
OpenAI documentation: https://docs.microsoft.com/en-us/azure/cognitive-services/openai
Bug: Missing OpenAI Resource & Deployment Model Support in Azure Service Operator ===========================================================

Q&A: Frequently Asked Questions

Q: What is the Azure Service Operator (ASO)?

A: The Azure Service Operator (ASO) is a powerful tool for managing Azure resources within Kubernetes environments. It allows users to deploy and manage Azure resources, such as virtual machines, storage accounts, and databases, within their Kubernetes clusters.

Q: What is the issue with the ASO?

A: The ASO currently lacks support for provisioning Azure OpenAI resources and Deployment Models. This is a significant limitation for organizations looking to leverage OpenAI services in their applications.

Q: What are the consequences of this issue?

A: The lack of support for OpenAI resources and Deployment Models in the ASO prevents users from managing OpenAI services via Kubernetes. This makes it challenging for organizations to adopt a GitOps approach for deploying and managing OpenAI resources, which can lead to increased costs, reduced efficiency, and decreased agility.

Q: What is a Custom Resource Definition (CRD)?

A: A Custom Resource Definition (CRD) is a way to define and manage custom resources within a Kubernetes cluster. CRDs allow users to create custom resources that can be used to manage specific applications or services.

Q: How would adding a CRD for OpenAI resources resolve the issue?

A: Adding a CRD for OpenAI resources would enable users to deploy and manage OpenAI resources through Kubernetes manifests. This would make it easier for organizations to adopt a GitOps approach for deploying and managing OpenAI resources.

Q: What is the impact of this issue on organizations?

A: The impact of this issue is significant, as it prevents users from managing OpenAI services via Kubernetes. This makes it challenging for organizations to adopt a GitOps approach for deploying and managing OpenAI resources, which can lead to increased costs, reduced efficiency, and decreased agility.

Q: Are there any workarounds for this issue?

A: There is no known workaround for this issue. However, users can consider using alternative tools or services to manage OpenAI resources, such as Azure CLI or Azure Portal.

Q: What is the solution to this issue?

A: The solution to this issue is to add support for provisioning Azure OpenAI resources and Deployment Models in the ASO. This can be achieved by creating a Custom Resource Definition (CRD) for "Microsoft.CognitiveServices/accounts" and "Microsoft.CognitiveServices/accounts/deployments".

Q: How can organizations get involved in resolving this issue?

A: Organizations can get involved in resolving this issue by providing feedback to the ASO team, reporting bugs, and contributing to the development of the ASO. This will help to ensure that the ASO meets the needs of users and provides the necessary support for managing Azure resources within Kubernetes environments.

Q: What is the future of the ASO?

A: The future of the ASO is bright, with ongoing development and improvement of the tool. The ASO team is committed to adding support for new Azure services and features, including OpenAI resources and Deployment Models.

Q: How can organizations stay up-to-date with the latest developments in the ASO?

A: Organizations can stay up-to-date with the latest developments in the ASO by following the ASO blog, attending ASO community events, and participating in the ASO community forums.

Q: What are the benefits of using the ASO?

A: The benefits of using the ASO include:

Simplified management of Azure resources within Kubernetes environments
Improved efficiency and reduced costs
Increased agility and flexibility
Enhanced security and compliance
Better support for DevOps and GitOps approaches

Q: How can organizations get started with using the ASO?

A: Organizations can get started with using the ASO by following the ASO documentation, attending ASO community events, and participating in the ASO community forums. This will provide them with the necessary knowledge and support to get started with using the ASO.