You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
### Design Extensibility of AI Solutions — Summary and Key Takeaways
1
+
### Design extensibility of AI solutions — Summary and key takeaways
2
2
3
3
Module 6 introduces solution architects to the principles and best practices for designing extensible AI solutions in enterprise environments, specifically leveraging Microsoft platforms. The module covers the use of custom models with Microsoft Foundry, agent design and operationalization in Microsoft 365 Copilot, extensibility strategies in Copilot Studio, and advanced integration using the Model Context Protocol (MCP). It emphasizes the importance of scalability, security, compliance, and adaptability in architecting AI systems that address unique organizational needs.
4
4
5
-
### Key Takeaways:
5
+
### Key takeaways
6
6
7
-
#### 1. Custom Models in Microsoft Foundry
7
+
#### Custom models in Microsoft Foundry
8
8
9
9
- Custom models are essential for scenarios requiring domain-specific reasoning, compliance, data sovereignty, unique workflows, and cost optimization.
10
10
@@ -14,7 +14,7 @@ Module 6 introduces solution architects to the principles and best practices for
- Copilot agents are modular, instruction-driven components that automate tasks, retrieve information, and collaborate within Microsoft 365 apps.
20
20
@@ -24,18 +24,18 @@ Module 6 introduces solution architects to the principles and best practices for
24
24
25
25
- Lifecycle management includes monitoring agent quality, updating instructions, enforcing access control, and versioning.
26
26
27
-
#### 3. Agent Extensibility in Copilot Studio
27
+
#### Agent extensibility in Copilot Studio
28
28
29
29
- Extensibility is implemented at four layers: instruction-level, skills/capabilities, integration, and pro-code customization via Visual Studio Code.
30
30
31
31
- Modular and reusable agent components enable faster updates, better compliance, and long-term maintainability.
32
32
33
33
- Multi-agent collaboration and domain-context patterns allow agents to specialize and adapt to different business environments.
34
34
35
-
#### 4. Model Context Protocol (MCP) in Copilot Studio
35
+
#### Model Context Protocol (MCP) in Copilot Studio
36
36
37
37
- MCP provides a standardized contract for agents to retrieve and interpret structured business context, ensuring consistent reasoning and compliance.
38
38
39
39
- MCP is particularly valuable for Dynamics 365 Finance & Operations scenarios, enabling agents to access business entities, workflows, and domain models.
40
40
41
-
- MCP-enabled agents improve accuracy, reduce hallucinations, enhance auditability, and
Copy file name to clipboardExpand all lines: learn-pr/wwl/design-extensibility-ai-solutions/includes/2-design-ai-solutions-custom-models-microsoft-foundry.md
+35-35Lines changed: 35 additions & 35 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,8 +1,8 @@
1
1
## Overview
2
2
3
-
This unit provides solution architects with expertlevel guidance on designing enterprisegrade AI solutions by using custom models in Microsoft Foundry. It explains when custom models are appropriate, how Foundry supports model development and lifecycle management, and how to architect scalable and secure AI solutions that integrate with Microsoft cloud services and lineofbusiness applications.
3
+
This unit provides solution architects with expert-level guidance on designing enterprise-grade AI solutions by using custom models in Microsoft Foundry. It explains when custom models are appropriate, how Foundry supports model development and lifecycle management, and how to architect scalable and secure AI solutions that integrate with Microsoft cloud services and line-of-business applications.
4
4
5
-
Microsoft Foundry enables organizations to build, finetune, evaluate, deploy, and operate custom AI models aligned with their business constraints, data governance requirements, and performance needs. Instead of relying only on prebuilt models, custom models provide deeper control over reasoning, domain specificity, and compliance—making them essential for advanced AI workloads.
5
+
Microsoft Foundry enables organizations to build, fine-tune, evaluate, deploy, and operate custom AI models aligned with their business constraints, data governance requirements, and performance needs. Instead of relying only on pre-built models, custom models provide deeper control over reasoning, domain specificity, and compliance—making them essential for advanced AI workloads.
6
6
7
7
In this learning module, students will learn the following:
8
8
@@ -11,33 +11,33 @@ In this learning module, students will learn the following:
11
11
- How to design AI solutions with custom models
12
12
- How to operationalize custom models in Foundry
13
13
14
-
## 1. When to Use Custom Models
14
+
## When to use custom models
15
15
16
16
Solution architects determine when custom AI models are needed by evaluating business complexity, data requirements, regulatory needs, and performance targets.
17
17
18
-
### Appropriate Scenarios
18
+
### Appropriate scenarios
19
19
20
-
**Domainspecific language and reasoning**<br>Industries such as legal, healthcare, engineering, finance, and manufacturing require AI models that understand specialized terminology and follow domainspecific logic.
20
+
**Domain-specific language and reasoning**<br>Industries such as legal, healthcare, engineering, finance, and manufacturing require AI models that understand specialized terminology and follow domain-specific logic.
21
21
22
-
**Highimpact decision processes**<br>Custom models are used when accuracy directly affects compliance, financial outcomes, or operational safety.
22
+
**High-impact decision processes**<br>Custom models are used when accuracy directly affects compliance, financial outcomes, or operational safety.
23
23
24
24
**Data sovereignty and governance mandates**<br>Custom models enable organizations to determine exactly how data is processed, stored, evaluated, and monitored.
25
25
26
-
**Unique workflows or personalization requirements**<br>Prebuilt copilots may not support custom interaction patterns, longrunning processes, or proprietary toolchains.
26
+
**Unique workflows or personalization requirements**<br>Pre-built copilots may not support custom interaction patterns, long-running processes, or proprietary toolchains.
27
27
28
-
**Cost optimization for highvolume inference**<br>Small, specialized custom models can provide performance and cost advantages over large foundation models.
28
+
**Cost optimization for high-volume inference**<br>Small, specialized custom models can provide performance and cost advantages over large foundation models.
29
29
30
-
## 2. Understanding Architecture Foundations in Microsoft Foundry
30
+
## Understanding architecture foundations in Microsoft Foundry
31
31
32
-
Microsoft Foundry provides an endtoend platform for custom model development, including tools for data preparation, training, evaluation, deployment, observability, and governance.
32
+
Microsoft Foundry provides an end-to-end platform for custom model development, including tools for data preparation, training, evaluation, deployment, observability, and governance.
33
33
34
-
### Key Architectural Elements
34
+
### Key architectural elements
35
35
36
-
**Model Catalog**<br>Offers base models that can be finetuned or enhanced using enterprise data and specialized tasks.
36
+
**Model Catalog**<br>Offers base models that can be fine-tuned or enhanced using enterprise data and specialized tasks.
37
37
38
-
**Training and FineTuning Pipelines**<br>Help orchestrate data ingestion, labeling, evaluation, and iterative improvements at scale.
38
+
**Training and Fine-tuning Pipelines**<br>Help orchestrate data ingestion, labeling, evaluation, and iterative improvements at scale.
39
39
40
-
**Agent and Tooling Integration**<br>Custom models can be embedded into Foundry agents and orchestrations to support multistep reasoning and automated workflows.
40
+
**Agent and Tooling Integration**<br>Custom models can be embedded into Foundry agents and orchestrations to support multi-step reasoning and automated workflows.
41
41
42
42
**Responsible AI Controls**<br>Includes content filtering, safety evaluation, transparency artifacts, policy enforcement, and auditability.
Map objectives to use cases where custom models outperform standard copilots.
61
61
62
-
### Step 2 — Assess Data Requirements
62
+
### Step 2 — Assess data requirements
63
63
64
64
Evaluate available proprietary datasets.
65
65
66
66
Identify gaps in labeling, quality, diversity, or structure.
67
67
68
68
Ensure governance policies allow data to be used in model training.
69
69
70
-
### Step 3 — Select the Custom Model Path
70
+
### Step 3 — Select the custom model path
71
71
72
-
#### Typical options include:
72
+
#### Typical options include
73
73
74
-
**Finetuning foundation models**<br>Adjust behavior using domain datasets without full retraining.
74
+
**Fine-tuning foundation models**<br>Adjust behavior using domain datasets without full retraining.
75
75
76
-
**Training domainbuilt small models**<br>Useful for lightweight tasks requiring speed and edge compatibility.
76
+
**Training domain-built small models**<br>Useful for lightweight tasks requiring speed and edge compatibility.
77
77
78
78
**Hybrid architectures**<br>Combining custom models with prebuilt copilots for augmented reasoning.
79
79
80
-
### Step 4 — Integration with Enterprise Systems
80
+
### Step 4 — Integration with enterprise systems
81
81
82
-
#### Custom models should integrate with:
82
+
#### Custom models should integrate with
83
83
84
84
Dynamics 365 applications
85
85
@@ -91,37 +91,37 @@ Azure AI Search and data stores
91
91
92
92
Business process automation pipelines
93
93
94
-
### Step 5 — Validation and Evaluation
94
+
### Step 5 — Validation and evaluation
95
95
96
-
#### Establish a rigorous testing plan:
96
+
#### Establish a rigorous testing plan
97
97
98
-
Scenariobased evaluations
98
+
Scenario-based evaluations
99
99
100
100
Safety and bias analysis
101
101
102
102
Stress, latency, and scaling tests
103
103
104
104
ROI measurement and business validation
105
105
106
-
## 4. Operationalizing Custom Models in Foundry
106
+
## Operationalizing custom models in Foundry
107
107
108
108
Modern AI systems require robust operational frameworks, especially with custom AI models. Foundry has tools to help support these custom AI models for long term feasibility.
109
109
110
-
### Key Operational Components
110
+
### Key operational components
111
111
112
112
**Model Monitoring and Observability**<br>Track drift, performance degradation, user friction areas, latency, and unexpected model outputs.
113
113
114
114
**Governance and Compliance Controls**<br>Ensure every deployment meets enterprise privacy, security, and regulatory requirements.
115
115
116
116
**Versioning and Lifecycle Management**<br>Maintain clear model version trails, update pipelines, and rollback strategies.
117
117
118
-
**Deployment Automation (MLOps/GenAIOps)**<br>Automate validations, approval workflows, and environmentspecific deployments.
118
+
**Deployment Automation (MLOps/GenAIOps)**<br>Automate validations, approval workflows, and environment-specific deployments.
119
119
120
-
## 5. Professional Visuals (TextBased)
120
+
## Professional visuals (text-based)
121
121
122
122
These visuals can be directly converted into diagrams for Word or PowerPoint.
123
123
124
-
### Visual A — Custom Model Decision Matrix
124
+
### Visual A — Custom model decision matrix
125
125
126
126
Decision Factor | Standard Copilot | Custom Model (Foundry)
127
127
@@ -137,17 +137,17 @@ Data confidentiality | Medium | Full control
137
137
138
138
Workflow complexity | Low/Medium | High
139
139
140
-
Inference cost optimization | Moderate | High (SLMs)
140
+
Inference cost optimization | Moderate | High (small language models)
141
141
142
-
### Visual B — Custom Model Development Lifecycle
142
+
### Visual B — Custom model development lifecycle
143
143
144
144
Business Goal → Data Collection → Data Preparation →
145
145
146
146
Model Selection → Training/Fine-Tuning → Evaluation →
0 commit comments