[LAB] AKS GPU Cluster on AML

[maljazaery]

Please describe the lab you are proposing
This Lab will be focusing on creating an AML (Azure Machine Learning) compute backed by an AKS (Azure Kubernetes Service) GPU with IB cluster and running a distributed AML job on it with Infiniband support.

For more details:
https://github.com/maljazaery/AML_AKS_GPU_IB_CLUSTER/blob/main/main.ipynb

If possible, provide a rough outline of the proposed lab

• Prepare Azure resources
• Deploy and configure the AKS gpu cluster with Infiniband
• Install required Kubernetes and AzureML components
• Attach the cluster to AzureML and validate Infiniband performance
• Submit AML Job for NCCL test.

Potential category. Please check one.

• Networking
• Security
• Storage
• Operations
• [X ] AI/ML
• Platform Engineering
• Other. Please specify in a new line below if none of the categories above fit.

Are you willing to be added to the CODEOWNERS file for this lab?

• [ X] Yes