Skip to content

sessions-tutorial-deploy-autogen.md

Latest commit

 

History

History
93 lines (71 loc) · 3.28 KB

sessions-tutorial-deploy-autogen.md

File metadata and controls

93 lines (71 loc) · 3.28 KB
author anthonychu
ms.service azure-container-apps
ms.topic include
ms.date 05/08/2024
ms.author antchu

Optional: Deploy the sample app to Azure Container Apps

To deploy the FastAPI app to Azure Container Apps, you need to create a container image and push it to a container registry. Then you can deploy the image to Azure Container Apps. The az containerapp up command combines these steps into a single command.

You then need to configure managed identity for the app and assign it the proper roles to access Azure OpenAI and the session pool.

  1. Set the variables for the Container Apps environment and app name:

    ENVIRONMENT_NAME=aca-sessions-tutorial-env
CONTAINER_APP_NAME=chat-api

  2. Build and deploy the app to Azure Container Apps:

    az containerapp up \
    --name $CONTAINER_APP_NAME \
    --resource-group $RESOURCE_GROUP_NAME \
    --location $SESSION_POOL_LOCATION \
    --environment $ENVIRONMENT_NAME \
    --env-vars 'OAI_CONFIG_LIST=[{"model": "gpt-4", "api_key": "<AZURE_OPENAI_KEY>", "api_type": "azure", "base_url": "<AZURE_OPENAI_ENDPOINT>", "api_version": "2023-12-01-preview"}]' 'POOL_MANAGEMENT_ENDPOINT=<SESSION_POOL_MANAGEMENT_ENDPOINT>' \
    --source .

    Replace <AZURE_OPENAI_ENDPOINT> with the Azure OpenAI account endpoint, <AZURE_OPENAI_KEY> with the Azure OpenAI key, and <SESSION_POOL_MANAGEMENT_ENDPOINT> with the session pool management endpoint.

  3. Enable the system-assigned managed identity for the app:

    az containerapp identity assign \
    --name $CONTAINER_APP_NAME \
    --resource-group $RESOURCE_GROUP_NAME \
    --system-assigned

  4. For the app to access the session pool, you need to assign the managed identity the proper roles.

    1. Retrieve the managed identity's principal ID:

      az containerapp show \
    --name $CONTAINER_APP_NAME \
    --resource-group $RESOURCE_GROUP_NAME \
    --query identity.principalId \
    --output tsv

    2. Retrieve the session pool resource ID:

      az containerapp sessionpool show \
    --name $SESSION_POOL_NAME \
    --resource-group $RESOURCE_GROUP_NAME \
    --query id \
    --output tsv

    3. Assign the managed identity the Azure ContainerApps Session Executor and Contributor roles on the session pool:

      Before you run the following command, replace <PRINCIPAL_ID> and <SESSION_POOL_RESOURCE_ID> with the values you retrieved in the previous steps.

      az role assignment create \
    --role "Azure ContainerApps Session Executor" \
    --assignee <PRINCIPAL_ID> \
    --scope <SESSION_POOL_RESOURCE_ID>

az role assignment create \
    --role "Contributor" \
    --assignee <PRINCIPAL_ID> \
    --scope <SESSION_POOL_RESOURCE_ID>

  5. Retrieve the app's fully qualified domain name (FQDN):

    az containerapp show \
    --name $CONTAINER_APP_NAME \
    --resource-group $RESOURCE_GROUP_NAME \
    --query properties.configuration.ingress.fqdn \
    --output tsv

  6. Open the browser to https://<FQDN>/docs to test the deployed app.