You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: learn-pr/wwl/design-overall-ai-strategy-business-solutions/includes/11-develop-use-cases-customized-small-language-models-solution.md
+15-15Lines changed: 15 additions & 15 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,13 +6,13 @@ Recent advances in SLMs such as **Phi3** demonstrate performance previously asso
6
6
7
7
Customized SLMs allow organizations to:
8
8
9
-
- Improve accuracy on domain-specific tasks
9
+
- Improve accuracy on domain-specific tasks.
10
10
11
-
- Embed specialized reasoning safely within enterprise environments
11
+
- Embed specialized reasoning safely within enterprise environments.
12
12
13
-
- Reduce cost vs. large model fine-tuning
13
+
- Reduce cost vs. large model fine-tuning.
14
14
15
-
- Enable offline or near-edge operation for compliance or performance
15
+
- Enable offline or near-edge operation for compliance or performance.
16
16
17
17
SLMs have the advantage with specific factors such as cost, latency, and control. But it's a common misconception that they're always safer than LLMs and always reduce incorrect information. It's important as an architect to determine when an SLM will make more sense than a large model and considerations such as risks of over-using SLMs in an organization.
18
18
@@ -50,13 +50,13 @@ SLMs minimize incorrect information by constraining model behavior around enterp
50
50
51
51
When latency, cost, or compute footprint matters:
52
52
53
-
- Mobile, IoT, or edge devices
53
+
- Mobile, IoT, or edge devices.
54
54
55
-
- High-volume inference environments
55
+
- High-volume inference environments.
56
56
57
-
- Real-time analytics or decision systems
57
+
- Real-time analytics or decision systems.
58
58
59
-
- Scenarios with intermittent or restricted connectivity
59
+
- Scenarios with intermittent or restricted connectivity.
60
60
61
61
SLMs reduce memory footprint significantly and ensure inference remains cost-predictable.
62
62
@@ -94,11 +94,11 @@ SLMs can be tuned to reflect organizational structured knowledge patterns.
94
94
95
95
SLMs can serve as orchestrators or planners when:
96
96
97
-
- Low-cost chain-of-thought reasoning is required
97
+
- Low-cost chain-of-thought reasoning is required.
98
98
99
-
- Multi-agent architectures rely on distributed reasoning
99
+
- Multi-agent architectures rely on distributed reasoning.
100
100
101
-
- Workflow routing requires domain logic
101
+
- Workflow routing requires domain logic.
102
102
103
103
SLMs with tuned reasoning outperform larger general-purpose models in specialized environments.
104
104
@@ -142,11 +142,11 @@ It's important to keep common pitfalls and risks in mind when identifying whethe
142
142
143
143
### Data requirements
144
144
145
-
- High-quality curated datasets
145
+
- High-quality curated datasets.
146
146
147
-
- Domain-specific terminology and structured examples
147
+
- Domain-specific terminology and structured examples.
148
148
149
-
- Clean and labeled text corpora
149
+
- Clean and labeled text corpora.
150
150
151
151
### Safety & governance requirements
152
152
@@ -176,7 +176,7 @@ When evaluating an SLM, architects can measure its success through specific metr
176
176
177
177
- Drift or degradation over time
178
178
179
-
**References (URLs you provided)**
179
+
**References**
180
180
181
181
-[Small Language Models for Application Interactions: A Case Study](https://arxiv.org/pdf/2405.20347)
Copy file name to clipboardExpand all lines: learn-pr/wwl/design-overall-ai-strategy-business-solutions/includes/4-design-multi-agent-solution.md
+18-18Lines changed: 18 additions & 18 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,24 +2,24 @@
2
2
3
3
By the end of this unit, learners will be able to:
4
4
5
-
- Apply a decision framework to choose **single-agent vs. multi-agent** architectures and justify the tradeoffs in security, scale, latency, cost, and operability
6
-
- Select the **right platform** for each agent role—**Microsoft 365 Copilot (SaaS)**, **Copilot Studio (low-code SaaS)**, or **Microsoft Foundry (pro-code PaaS/IaaS)**—and define clear boundaries and contracts between agents
7
-
- Orchestrate collaborating agents using proven **orchestration patterns** (sequential, concurrent, group chat, handoff, and Magentic) and implement them with the **Microsoft Agent Framework SDK**
8
-
- Design a **connected agents** solution that assigns specialized roles and tools to each agent and validates the design through iterative prototyping
5
+
- Apply a decision framework to choose **single-agent vs. multi-agent** architectures and justify the tradeoffs in security, scale, latency, cost, and operability.
6
+
- Select the **right platform** for each agent role—**Microsoft 365 Copilot (SaaS)**, **Copilot Studio (low-code SaaS)**, or **Microsoft Foundry (pro-code PaaS/IaaS)**—and define clear boundaries and contracts between agents.
7
+
- Orchestrate collaborating agents using proven **orchestration patterns** (sequential, concurrent, group chat, handoff, and Magentic) and implement them with the **Microsoft Agent Framework SDK**.
8
+
- Design a **connected agents** solution that assigns specialized roles and tools to each agent and validates the design through iterative prototyping.
9
9
10
10
## When to use multi-agent and when not to
11
11
12
12
**Start simple, scale when the evidence requires it.** A **single-agent** design consolidates logic, reduces coordination overhead, and simplifies governance—ideal when the domain is bounded, time-to-value is critical, and operating costs must be minimized. In contrast, **multi-agent** systems decompose responsibilities across specialized agents to enforce separation of concerns, align with team boundaries, and scale across domains—at the cost of added orchestration, latency at handoffs, and a larger security surface.
13
13
14
14
**Choose multi-agent first when at least one of these is true**:
15
15
16
-
- You must **cross security or compliance boundaries** (for example, strict data classifications or separation of duties)
16
+
- You must **cross security or compliance boundaries** (for example, strict data classifications or separation of duties).
17
17
18
-
- Multiple teams own distinct knowledge, data, or release cycles that benefit from **decoupled agents**
18
+
- Multiple teams own distinct knowledge, data, or release cycles that benefit from **decoupled agents**.
19
19
20
-
- The roadmap clearly demands **future expansion** across 3-5+ functions—modularity avoids later refactors
20
+
- The roadmap clearly demands **future expansion** across 3-5+ functions—modularity avoids later refactors.
21
21
22
-
- The business requirements dictate a series of actions occur with multiple dependencies across two or more workstreams
22
+
- The business requirements dictate a series of actions occur with multiple dependencies across two or more workstreams.
23
23
24
24
**Otherwise, validate with a single agent** before adding orchestration. Many "multi-agent" needs can be met with **persona switching**, improved retrieval, policy controls, or a larger context window.
25
25
@@ -65,15 +65,15 @@ When agents collaborate, adopt **explicit orchestration** rather than ad hoc cha
65
65
66
66
A robust multi-agent solution in **Foundry** follows these steps:
67
67
68
-
-**Define the main agent** (mission, guardrails, success metrics) and its **tooling** (retrieval sources, actions, evaluators)
68
+
-**Define the main agent** (mission, guardrails, success metrics) and its **tooling** (retrieval sources, actions, evaluators).
69
69
70
-
-**Identify connected agents** by role (for example, _Planner_, _Researcher_, _Reviewer_, _Actuator_), each with a minimal instruction set, scoped permissions, and well-defined inputs/outputs
70
+
-**Identify connected agents** by role (for example, _Planner_, _Researcher_, _Reviewer_, _Actuator_), each with a minimal instruction set, scoped permissions, and well-defined inputs/outputs.
71
71
72
-
-**Model collaboration**: choose orchestration patterns (above), define interface contracts, and design state handoffs (IDs, evidence, citations)
72
+
-**Model collaboration**: choose orchestration patterns (above), define interface contracts, and design state handoffs (IDs, evidence, citations).
73
73
74
-
-**Prototype quickly**: build a **connected agents** sample, run scenario tests, and measure latency, cost, accuracy, and alignment
74
+
-**Prototype quickly**: build a **connected agents** sample, run scenario tests, and measure latency, cost, accuracy, and alignment.
75
75
76
-
-**Iterate**: prune redundant agents, consolidate roles when evidence shows a single agent suffices, and strengthen evaluation gates
76
+
-**Iterate**: prune redundant agents, consolidate roles when evidence shows a single agent suffices, and strengthen evaluation gates.
77
77
78
78
### Evaluation checkpoints
79
79
@@ -87,9 +87,9 @@ A robust multi-agent solution in **Foundry** follows these steps:
87
87
88
88
- Are **observability hooks** (spans, events, metrics) in place at every handoff?
89
89
90
-
- Does the main agent use natural language to route tasks, eliminating the need for hardcoded logic
90
+
- Does the main agent use natural language to route tasks, eliminating the need for hardcoded logic?
91
91
92
-
- Are the agents configured using a no-code interface in the Foundry portal or programmatically via the Python SDK
92
+
- Are the agents configured using a no-code interface in the Foundry portal or programmatically via the Python SDK?
93
93
94
94
## Reference architecture
95
95
@@ -121,11 +121,11 @@ A robust multi-agent solution in **Foundry** follows these steps:
121
121
122
122
## Summary
123
123
124
-
- Prefer **single-agent** for bounded domains and speed; adopt **multi-agent** when **security boundaries**, **team structures**, or **roadmap growth** require modularity
124
+
- Prefer **single-agent** for bounded domains and speed; adopt **multi-agent** when **security boundaries**, **team structures**, or **roadmap growth** require modularity.
125
125
126
-
- Use **Microsoft 365 Copilot** for inflow value, **Copilot Studio** for rapid business workflows, and **Foundry** for **connected, pro-code** orchestration
126
+
- Use **Microsoft 365 Copilot** for inflow value, **Copilot Studio** for rapid business workflows, and **Foundry** for **connected, pro-code** orchestration.
127
127
128
-
- Implement explicit **orchestration patterns** with the **Microsoft Agent Framework SDK** for reliability and transparency
128
+
- Implement explicit **orchestration patterns** with the **Microsoft Agent Framework SDK** for reliability and transparency.
Copy file name to clipboardExpand all lines: learn-pr/wwl/design-overall-ai-strategy-business-solutions/includes/6-define-solution-rules-constraints-building-ai-components.md
+44-44Lines changed: 44 additions & 44 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,11 +6,11 @@ This unit guides solution architects through defining **solution rules and archi
6
6
7
7
By the end of this unit, learners will be able to:
8
8
9
-
- Identify how platform differences influence architectural constraints
10
-
- Define required guardrails for data, actions, and tool access
11
-
- Decide how to establish solution-level rules for responsible behavior
12
-
- Decide how to define environment, networking, and operational constraints
13
-
- Decide how to create a unified rule framework across Copilot Studio and Foundry
9
+
- Identify how platform differences influence architectural constraints.
10
+
- Define required guardrails for data, actions, and tool access.
11
+
- Decide how to establish solution-level rules for responsible behavior.
12
+
- Decide how to define environment, networking, and operational constraints.
13
+
- Decide how to create a unified rule framework across Copilot Studio and Foundry.
14
14
15
15
## Architectural foundations and platform roles
16
16
@@ -32,13 +32,13 @@ Copilot Studio provides a **low-code environment** for building task and retriev
32
32
33
33
#### Solution rules
34
34
35
-
- Use Copilot Studio for **workflow-bounded**, **task-driven**, or **information retrieval** scenarios
35
+
- Use Copilot Studio for **workflow-bounded**, **task-driven**, or **information retrieval** scenarios.
36
36
37
-
- Apply strict **connector scoping** to control data exposure
37
+
- Apply strict **connector scoping** to control data exposure.
38
38
39
-
- Define **task boundaries** that prevent the agent from making high-impact decisions
39
+
- Define **task boundaries** that prevent the agent from making high-impact decisions.
@@ -56,35 +56,35 @@ Foundry supports **pro-code, high-complexity AI applications** and multi-agent s
56
56
57
57
#### Solution rules
58
58
59
-
- Use Foundry for **complex reasoning**, **multi-agent orchestration**, or **custom tool integration**
59
+
- Use Foundry for **complex reasoning**, **multi-agent orchestration**, or **custom tool integration**.
60
60
61
-
- Define strict **action boundaries** for tools that modify systems or trigger workflows
61
+
- Define strict **action boundaries** for tools that modify systems or trigger workflows.
62
62
63
-
- Apply **evaluation pipelines** to audit safety, correctness, and drift
63
+
- Apply **evaluation pipelines** to audit safety, correctness, and drift.
64
64
65
-
- Use **role separation** so each agent has scoped permissions
65
+
- Use **role separation** so each agent has scoped permissions.
66
66
67
67
### Foundry tools
68
68
69
69
Foundry Tools include model catalogs, tool APIs, agent orchestration frameworks, evaluation utilities, and developer SDKs. They provide a versatile foundation but require carefully defined rules.
70
70
71
71
#### Key constraints
72
72
73
-
- Developers must manage memory lifetime, context, and data sensitivity
73
+
- Developers must manage memory lifetime, context, and data sensitivity.
74
74
75
-
- Agents can call external tools, making permissioning critical
75
+
- Agents can call external tools, making permissioning critical.
76
76
77
-
- Orchestration complexity increases with multi-agent designs
77
+
- Orchestration complexity increases with multi-agent designs.
78
78
79
79
#### Solution rules
80
80
81
-
- Implement **least-privilege** permissions for each tool
81
+
- Implement **least-privilege** permissions for each tool.
82
82
83
-
- Use evaluation tools to test **failure cases** and **undesirable behavior**
83
+
- Use evaluation tools to test **failure cases** and **undesirable behavior**.
84
84
85
-
- Define **clear escalation rules** for when an agent must defer to humans
85
+
- Define **clear escalation rules** for when an agent must defer to humans.
86
86
87
-
- Document all tool integrations with security and auditing considerations
87
+
- Document all tool integrations with security and auditing considerations.
88
88
89
89
## Data constraints and governance boundaries
90
90
@@ -94,29 +94,29 @@ Solution architects must define explicit guardrails around data to avoid overexp
94
94
95
95
#### Rules
96
96
97
-
- Provide agents **only the data they require**
97
+
- Provide agents **only the data they require**.
98
98
99
-
- Mask sensitive fields where retrieval is needed but full data is unnecessary
99
+
- Mask sensitive fields where retrieval is needed but full data is unnecessary.
100
100
101
-
- Limit grounding sources to curated, authoritative datasets
101
+
- Limit grounding sources to curated, authoritative datasets.
102
102
103
-
- For generative tasks, enforce constraints on what content agents can produce
103
+
- For generative tasks, enforce constraints on what content agents can produce.
104
104
105
105
#### Data movement and storage constraints
106
106
107
-
- Prevent persistent storage of messages unless compliance requires it
107
+
- Prevent persistent storage of messages unless compliance requires it.
108
108
109
-
- Define memory policy (ephemeral vs. persistent)
109
+
- Define memory policy (ephemeral vs. persistent).
110
110
111
-
- Restrict cross-domain data access (HR, Finance, Legal)
111
+
- Restrict cross-domain data access (HR, Finance, Legal).
112
112
113
113
#### Compliance and regulatory constraints
114
114
115
-
- Agents must conform to organizational regulatory obligations
115
+
- Agents must conform to organizational regulatory obligations.
116
116
117
-
- High-risk tasks (financial approvals, legal drafting, health decisions) require human review
117
+
- High-risk tasks (financial approvals, legal drafting, health decisions) require human review.
118
118
119
-
- Enable mandatory auditing for tool invocation
119
+
- Enable mandatory auditing for tool invocation.
120
120
121
121
## Behavioral rules and responsible AI constraints
122
122
@@ -132,45 +132,45 @@ Define what an agent is _allowed_ and _not allowed_ to do.
132
132
- "Agent may not decide"
133
133
- "Agent may not execute financial transactions"
134
134
135
-
- Include disallowed behaviors aligned to security, privacy, and safety policies
135
+
- Include disallowed behaviors aligned to security, privacy, and safety policies.
136
136
137
-
- Use structured instructions to prevent unsafe improvisation
137
+
- Use structured instructions to prevent unsafe improvisation.
138
138
139
139
#### Responsible AI (RAI) controls
140
140
141
-
- Mandate use of bias and safety evaluation pipelines
141
+
- Mandate use of bias and safety evaluation pipelines.
142
142
143
-
- Apply strict instructions for citing sources, representing facts, and avoiding incorrect information
143
+
- Apply strict instructions for citing sources, representing facts, and avoiding incorrect information.
144
144
145
-
- Require human-in-the-loop checkpoints for high-impact actions
145
+
- Require human-in-the-loop checkpoints for high-impact actions.
146
146
147
147
## Environment, deployment, and networking constraints
148
148
149
149
### Environment rules
150
150
151
-
- Copilot Studio: Operates inside Microsoft 365 tenant boundary; isolated per environment
151
+
- Copilot Studio: Operates inside Microsoft 365 tenant boundary; isolated per environment.
0 commit comments