Skip to content

Commit 2ed7a91

Browse files
authored
Merge pull request #303701 from jeffwmartinez/jefmarti-ai
initial ai section update
2 parents d3af592 + b780635 commit 2ed7a91

2 files changed

Lines changed: 75 additions & 20 deletions

File tree

articles/container-apps/TOC.yml

Lines changed: 24 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -62,14 +62,6 @@
6262
href: application-lifecycle-management.md
6363
- name: Jobs
6464
href: jobs.md
65-
- name: Dynamic sessions
66-
items:
67-
- name: Overview
68-
href: sessions.md
69-
- name: Usage
70-
href: sessions-usage.md
71-
- name: Session pools
72-
href: session-pool.md
7365
- name: Microservices
7466
href: microservices.md
7567
- name: Planned maintenance
@@ -188,6 +180,30 @@
188180
href: troubleshoot-container-start-failures.md
189181
- name: Reliability in Azure Container Apps
190182
href: ../reliability/reliability-azure-container-apps.md?toc=/azure/container-apps/toc.json&bc=/azure/container-apps/breadcrumb/toc.json
183+
- name: AI integration
184+
items:
185+
- name: AI integration
186+
href: ai-integration.md
187+
- name: GPUs
188+
items:
189+
- name: Serverless GPUs
190+
href: gpu-serverless-overview.md
191+
- name: GPU types
192+
href: gpu-types.md
193+
- name: Tutorials
194+
items:
195+
- name: Generate images with serverless GPUs
196+
href: gpu-image-generation.md
197+
- name: Deploy an NVIDIA Llama3 NIM
198+
href: serverless-gpu-nim.md
199+
- name: Dynamic sessions
200+
items:
201+
- name: Overview
202+
href: sessions.md
203+
- name: Usage
204+
href: sessions-usage.md
205+
- name: Session pools
206+
href: session-pool.md
191207
- name: Observability
192208
items:
193209
- name: Overview
@@ -300,18 +316,6 @@
300316
href: workload-profiles-manage-cli.md
301317
- name: Portal
302318
href: workload-profiles-manage-portal.md
303-
- name: GPUs
304-
items:
305-
- name: Serverless GPUs
306-
href: gpu-serverless-overview.md
307-
- name: GPU types
308-
href: gpu-types.md
309-
- name: Tutorials
310-
items:
311-
- name: Generate images with serverless GPUs
312-
href: gpu-image-generation.md
313-
- name: Deploy an NVIDIA Llama3 NIM
314-
href: serverless-gpu-nim.md
315319
- name: Microservices
316320
items:
317321
- name: Developing with Dapr
Lines changed: 51 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,51 @@
1+
---
2+
title: AI integration with Azure Container Apps
3+
description: Examples for running AI workloads in Azure Container Apps, including GPU-powered inference, dynamic sessions, and deploying Azure AI Foundry models.
4+
author: jefmarti
5+
ms.author: jefmarti
6+
ms.service: azure-container-apps
7+
ms.date: 10/03/2025
8+
ms.topic: article
9+
---
10+
11+
# AI integration with Azure Container Apps
12+
13+
Azure Container Apps is a serverless container platform that simplifies the deployment and scaling of microservices and AI-powered applications. With native support for GPU workloads, seamless integration with Azure AI services, and flexible deployment options, it is an ideal platform for building intelligent, cloud-native solutions.
14+
15+
16+
## GPU-powered inference
17+
18+
Use GPU accelerated workload profiles to meet a variety of your AI workload needs, including:
19+
20+
- **[Serverless GPUs](./gpu-serverless-overview.md)**: Ideal for variable traffic scenarios and cost-sensitive inference workloads.
21+
- **Dedicated GPUs**: best for continuous, low-latency inference scenarios.
22+
- **Scale to zero**: automatically scale down idle GPU resources to minimize costs.
23+
24+
## Dynamic sessions for AI-generated code
25+
26+
Dynamic sessions provide a secure, isolated environment for executing AI-generated code. Perfect for scenarios like sandboxed execution, code evaluation, and AI agents.
27+
28+
Supported session types include:
29+
- **[Platform managed built-in containers](./sessions-code-interpreter.md)**: a platform-managed container that supports executing code in Python and Node.js.
30+
- **[Custom containers](./sessions-custom-container.md)**: create a sessions pool using a custom container for specialized workloads or additional language support.
31+
32+
## Deploying Azure AI Foundry models
33+
34+
Azure Container Apps integrates with Azure AI Foundry, which enables you to deploy curated AI models directly into your containerized environments. This integration simplifies model deployment and management, making it easier to build intelligent applications on Container Apps.
35+
36+
### Sample projects
37+
38+
The following are a few examples that demonstrate AI integration with Azure Container Apps. These samples showcase various AI capabilities, including OpenAI integration, multi-agent coordination, and retrieval-augmented generation (RAG) using Azure AI Search. For more samples, visit the [template library](https://azure-sdk.github.io/awesome-azd/?name=azure+container+apps).
39+
40+
| Sample | Description |
41+
|--------|-------------|
42+
| [Chat app with Azure OpenAI](https://github.com/Azure-Samples/container-apps-openai) | ChatGPT-like apps using OpenAI, LangChain, ChromaDB, and Chainlit deployed to ACA using Terraform. |
43+
| [Host an MCP server](https://github.com/Azure-Samples/azure-container-apps-ai-mcp) | Demonstrates multi-agent coordination using the MCP protocol with Azure OpenAI and GitHub models in Container Apps. |
44+
| [MCP client and server](https://github.com/Azure-Samples/openai-mcp-agent-dotnet) | .NET-based MCP agent app using Azure OpenAI with a TypeScript MCP server, both hosted on ACA. |
45+
| [Remote MCP server](https://github.com/Azure-Samples/mcp-container-ts) | TypeScript-based MCP server template for Container Apps, ideal for building custom AI toolchains. |
46+
| [Dynamic session Python code interpreter](https://github.com/Azure-Samples/aca-python-code-interpreter-session) | Dynamic session for executing Python code in a secure environment. |
47+
48+
## Related content
49+
- [Multiple-agent workflow automation](/azure/architecture/ai-ml/idea/multiple-agent-workflow-automation)
50+
51+

0 commit comments

Comments
 (0)