|
| 1 | +--- |
| 2 | +title: AI integration with Azure Container Apps |
| 3 | +description: Examples for running AI workloads in Azure Container Apps, including GPU-powered inference, dynamic sessions, and deploying Azure AI Foundry models. |
| 4 | +author: jefmarti |
| 5 | +ms.author: jefmarti |
| 6 | +ms.service: azure-container-apps |
| 7 | +ms.date: 10/03/2025 |
| 8 | +ms.topic: article |
| 9 | +--- |
| 10 | + |
| 11 | +# AI integration with Azure Container Apps |
| 12 | + |
| 13 | +Azure Container Apps is a serverless container platform that simplifies the deployment and scaling of microservices and AI-powered applications. With native support for GPU workloads, seamless integration with Azure AI services, and flexible deployment options, it is an ideal platform for building intelligent, cloud-native solutions. |
| 14 | + |
| 15 | + |
| 16 | +## GPU-powered inference |
| 17 | + |
| 18 | +Use GPU accelerated workload profiles to meet a variety of your AI workload needs, including: |
| 19 | + |
| 20 | +- **[Serverless GPUs](./gpu-serverless-overview.md)**: Ideal for variable traffic scenarios and cost-sensitive inference workloads. |
| 21 | +- **Dedicated GPUs**: best for continuous, low-latency inference scenarios. |
| 22 | +- **Scale to zero**: automatically scale down idle GPU resources to minimize costs. |
| 23 | + |
| 24 | +## Dynamic sessions for AI-generated code |
| 25 | + |
| 26 | +Dynamic sessions provide a secure, isolated environment for executing AI-generated code. Perfect for scenarios like sandboxed execution, code evaluation, and AI agents. |
| 27 | + |
| 28 | +Supported session types include: |
| 29 | +- **[Platform managed built-in containers](./sessions-code-interpreter.md)**: a platform-managed container that supports executing code in Python and Node.js. |
| 30 | +- **[Custom containers](./sessions-custom-container.md)**: create a sessions pool using a custom container for specialized workloads or additional language support. |
| 31 | + |
| 32 | +## Deploying Azure AI Foundry models |
| 33 | + |
| 34 | +Azure Container Apps integrates with Azure AI Foundry, which enables you to deploy curated AI models directly into your containerized environments. This integration simplifies model deployment and management, making it easier to build intelligent applications on Container Apps. |
| 35 | + |
| 36 | +### Sample projects |
| 37 | + |
| 38 | +The following are a few examples that demonstrate AI integration with Azure Container Apps. These samples showcase various AI capabilities, including OpenAI integration, multi-agent coordination, and retrieval-augmented generation (RAG) using Azure AI Search. For more samples, visit the [template library](https://azure-sdk.github.io/awesome-azd/?name=azure+container+apps). |
| 39 | + |
| 40 | +| Sample | Description | |
| 41 | +|--------|-------------| |
| 42 | +| [Chat app with Azure OpenAI](https://github.com/Azure-Samples/container-apps-openai) | ChatGPT-like apps using OpenAI, LangChain, ChromaDB, and Chainlit deployed to ACA using Terraform. | |
| 43 | +| [Host an MCP server](https://github.com/Azure-Samples/azure-container-apps-ai-mcp) | Demonstrates multi-agent coordination using the MCP protocol with Azure OpenAI and GitHub models in Container Apps. | |
| 44 | +| [MCP client and server](https://github.com/Azure-Samples/openai-mcp-agent-dotnet) | .NET-based MCP agent app using Azure OpenAI with a TypeScript MCP server, both hosted on ACA. | |
| 45 | +| [Remote MCP server](https://github.com/Azure-Samples/mcp-container-ts) | TypeScript-based MCP server template for Container Apps, ideal for building custom AI toolchains. | |
| 46 | +| [Dynamic session Python code interpreter](https://github.com/Azure-Samples/aca-python-code-interpreter-session) | Dynamic session for executing Python code in a secure environment. | |
| 47 | + |
| 48 | +## Related content |
| 49 | +- [Multiple-agent workflow automation](/azure/architecture/ai-ml/idea/multiple-agent-workflow-automation) |
| 50 | + |
| 51 | + |
0 commit comments