Skip to content

Commit 66c347d

Browse files
committed
Feedback module 10
1 parent f5d4830 commit 66c347d

5 files changed

Lines changed: 151 additions & 151 deletions

learn-pr/wwl/design-alm-process-ai-powered-business-solutions/includes/2-design-alm-process-data-used-ai-models-agents.md

Lines changed: 18 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -22,17 +22,17 @@ By the end of this unit, learners are be able to:
2222

2323
#### Treat the following as versioned, promotable ALM artifacts:
2424

25-
**Training & fine-tuning datasets** (raw, curated, feature/embedding sets).
25+
* **Training & fine-tuning datasets** (raw, curated, feature/embedding sets).
2626

27-
**Evaluation/Testing datasets** and "golden" sets for regression testing.
27+
* **Evaluation/Testing datasets** and "golden" sets for regression testing.
2828

29-
**Grounding knowledge** (SharePoint/OneDrive corpora, Dataverse tables, wikis, KBs).
29+
* **Grounding knowledge** (SharePoint/OneDrive corpora, Dataverse tables, wikis, KBs).
3030

31-
**Prompt assets** (system prompts, prompt actions, templates).
31+
* **Prompt assets** (system prompts, prompt actions, templates).
3232

33-
**Policies & guardrails** (DLP, sensitivity labels, allowed connectors, action limits).
33+
* **Policies & guardrails** (DLP, sensitivity labels, allowed connectors, action limits).
3434

35-
**Run telemetry** (latency, token/cost, success/failure, safety events) and **feedback**.
35+
* **Run telemetry** (latency, token/cost, success/failure, safety events) and **feedback**.
3636

3737
### Environment strategy
3838

@@ -158,28 +158,28 @@ The below RACI chart is a representative sample for an organization. It's up to
158158

159159
## Operational telemetry and drift
160160

161-
Maintain **baseline metrics** per release: latency p95, success %, token/€ per task, safety flags/M runs.
161+
* Maintain **baseline metrics** per release: latency p95, success %, token/€ per task, safety flags/M runs.
162162

163-
Compare live to baseline; if drift exceeds thresholds, **auto-open an incident**, route to data owner, and pause affected actions.
163+
* Compare live to baseline; if drift exceeds thresholds, **auto-open an incident**, route to data owner, and pause affected actions.
164164

165-
Rerun evaluation suites nightly/weekly against **golden sets**; store time series for audit.
165+
* Rerun evaluation suites nightly/weekly against **golden sets**; store time series for audit.
166166

167167
## Checklists you can paste into your runbooks
168168

169169
### Go/NoGo before production
170170

171-
[ ] Data contract approved; asset tagged and discoverable.
172-
[ ] Sensitivity labels/DLP rules applied; connectors approved.
173-
[ ] Lineage graph current; dataset snapshot **immutable** and versioned.
174-
[ ] Evaluation thresholds met; safety risks mitigated.
175-
[ ] Residency decision recorded; cross-regions toggle reviewed.
176-
[ ] Dashboards, budgets, alerts, and rollback validated in Pre-Prod.
171+
* [ ] Data contract approved; asset tagged and discoverable.
172+
* [ ] Sensitivity labels/DLP rules applied; connectors approved.
173+
* [ ] Lineage graph current; dataset snapshot **immutable** and versioned.
174+
* [ ] Evaluation thresholds met; safety risks mitigated.
175+
* [ ] Residency decision recorded; cross-regions toggle reviewed.
176+
* [ ] Dashboards, budgets, alerts, and rollback validated in Pre-Prod.
177177

178178
### Retirement
179179

180-
[ ] Consumers notified; cutover plans executed.
181-
[ ] Snapshots archived/deleted per retention; access revoked.
182-
[ ] Audit and lineage preserved; catalog updated.
180+
* [ ] Consumers notified; cutover plans executed.
181+
* [ ] Snapshots archived/deleted per retention; access revoked.
182+
* [ ] Audit and lineage preserved; catalog updated.
183183

184184
## References
185185

learn-pr/wwl/design-alm-process-ai-powered-business-solutions/includes/3-design-alm-process-copilot-studio-agents-connectors-actions.md

Lines changed: 65 additions & 65 deletions
Original file line numberDiff line numberDiff line change
@@ -8,47 +8,47 @@ Architects learn how to structure solution components into managed lifecycles, e
88

99
Copilot Studio solutions typically include:
1010

11-
**Agents** (conversational or autonomous)
11+
* **Agents** (conversational or autonomous)
1212

13-
**Custom connectors**
13+
* **Custom connectors**
1414

15-
**Actions, skills, and prompt assets**
15+
* **Actions, skills, and prompt assets**
1616

17-
**Supporting Dataverse components**
17+
* **Supporting Dataverse components**
1818

19-
**Environment data and application settings**
19+
* **Environment data and application settings**
2020

2121
A mature ALM process ensures:
2222

23-
Version control of all solution artifacts
23+
* Version control of all solution artifacts
2424

25-
Clear separation between development, testing, and production
25+
* Clear separation between development, testing, and production
2626

27-
Monitoring and validation at each promotion stage
27+
* Monitoring and validation at each promotion stage
2828

29-
Compliance with governance, DLP, and data residency requirements
29+
* Compliance with governance, DLP, and data residency requirements
3030

31-
Sustainable lifecycle for updates and deprecations
31+
* Sustainable lifecycle for updates and deprecations
3232

3333
## 2. Recommended Environment Strategy
3434

3535
### Establish at least three core environments:
3636

37-
**Development (Dev)** - building and iterating on agents, connectors, and actions
37+
* **Development (Dev)** - building and iterating on agents, connectors, and actions
3838

39-
**Test (UAT/QA)** - validating behavior, evaluating prompts, regression checks
39+
* **Test (UAT/QA)** - validating behavior, evaluating prompts, regression checks
4040

41-
**Production (Prod)** - stable, approved, monitored implementation
41+
* **Production (Prod)** - stable, approved, monitored implementation
4242

4343
### Environment design principles:
4444

45-
No direct editing in production
45+
* No direct editing in production
4646

47-
Enforce role-based access at each tier
47+
* Enforce role-based access at each tier
4848

49-
Managed solutions only in Test and Prod
49+
* Managed solutions only in Test and Prod
5050

51-
Use solution layering to isolate changes
51+
* Use solution layering to isolate changes
5252

5353
### Professional Visual - Text Diagram
5454

@@ -70,49 +70,49 @@ Agents should move through lifecycle stages with predictable governance:
7070

7171
### 3.1 Development Stage
7272

73-
Draft agent scope, intents, and behaviors
73+
* Draft agent scope, intents, and behaviors
7474

75-
Build actions and prompts
75+
* Build actions and prompts
7676

77-
Add knowledge sources in Dev only
77+
* Add knowledge sources in Dev only
7878

79-
Test agent workflows with edge-case prompts
79+
* Test agent workflows with edge-case prompts
8080

8181
### 3.2 Testing Stage
8282

83-
Validate reasoning quality and output patterns
83+
* Validate reasoning quality and output patterns
8484

85-
Ensure grounding is reliable and compliant
85+
* Ensure grounding is reliable and compliant
8686

87-
Evaluate event-triggered actions
87+
* Evaluate event-triggered actions
8888

89-
Run regression tests on all agent topics
89+
* Run regression tests on all agent topics
9090

9191
### 3.3 Production Stage
9292

93-
Deploy via managed solutions
93+
* Deploy via managed solutions
9494

95-
Monitor usage, performance, and safety
95+
* Monitor usage, performance, and safety
9696

97-
Apply versioning and planned release cycles
97+
* Apply versioning and planned release cycles
9898

99-
Document change history
99+
* Document change history
100100

101101
## 4. ALM for Connectors
102102

103103
Connectors enable Copilot to interact with systems.
104104

105105
### Connector ALM principles
106106

107-
Build connectors via Dev environment only
107+
* Build connectors via Dev environment only
108108

109-
Validate authentication flows
109+
* Validate authentication flows
110110

111-
Apply DLP policies during Test
111+
* Apply DLP policies during Test
112112

113-
Publish connectors only in Prod after full review
113+
* Publish connectors only in Prod after full review
114114

115-
Track versions and rollback strategies
115+
* Track versions and rollback strategies
116116

117117
### Professional Visual - Connector Release Flow
118118

@@ -124,15 +124,15 @@ Actions represent executable steps triggered by agents.
124124

125125
### Action lifecycle
126126

127-
**Design** - Define outcome, inputs, outputs
127+
* **Design** - Define outcome, inputs, outputs
128128

129-
**Build** - Implement logic using Power Automate, plugins, or external APIs
129+
* **Build** - Implement logic using Power Automate, plugins, or external APIs
130130

131-
**Validate** - Confirm correct action sequencing and error handling
131+
* **Validate** - Confirm correct action sequencing and error handling
132132

133-
**Promote** - Move through Dev → Test → Prod via managed solutions
133+
* **Promote** - Move through Dev → Test → Prod via managed solutions
134134

135-
**Monitor** - Track success/failure rates and performance metrics
135+
* **Monitor** - Track success/failure rates and performance metrics
136136

137137
## 6. Version Control and Release Management
138138

@@ -148,65 +148,65 @@ Use Visual Studio Code for Copilot connector development where applicable
148148

149149
### Adopt release cadence
150150

151-
Monthly or sprint-based release cycles
151+
* Monthly or sprint-based release cycles
152152

153-
Emergency patch process for critical fixes
153+
* Emergency patch process for critical fixes
154154

155-
Rollback plan
155+
* Rollback plan
156156

157-
Change management plan for users
157+
* Change management plan for users
158158

159159
## 7. Governance and Compliance Controls
160160

161161
ALM must align with enterprise governance rules:
162162

163163
### Key controls
164164

165-
DLP policy enforcement
165+
* DLP policy enforcement
166166

167-
Environment-specific connector rules
167+
* Environment-specific connector rules
168168

169-
Data residency restrictions
169+
* Data residency restrictions
170170

171-
Enterprise-approved knowledge sources
171+
* Enterprise-approved knowledge sources
172172

173-
Review gate for safety, quality, and ethical risk
173+
* Review gate for safety, quality, and ethical risk
174174

175-
Monitoring dashboards for agent behavior
175+
* Monitoring dashboards for agent behavior
176176

177177
### Professional Visual - Governance Checklist
178178

179-
- [] DLP Policies Applied
180-
- [] Security Review Completed
181-
- [] Knowledge Sources Verified
182-
- [] Data Residency Confirmed
183-
- [] Risk & Safety Assessment Passed
184-
- [] Monitoring Enabled
179+
* [] DLP Policies Applied
180+
* [] Security Review Completed
181+
* [] Knowledge Sources Verified
182+
* [] Data Residency Confirmed
183+
* [] Risk & Safety Assessment Passed
184+
* [] Monitoring Enabled
185185

186186
## 8. Monitoring and Continuous Improvement
187187

188188
### Monitoring signals include:
189189

190-
Agent session success rate
190+
* Agent session success rate
191191

192-
Action execution health
192+
* Action execution health
193193

194-
Connector performance
194+
* Connector performance
195195

196-
Prompt regression—quality changes over time
196+
* Prompt regression—quality changes over time
197197

198-
User satisfaction insights
198+
* User satisfaction insights
199199

200200
### Continuous improvement loop:
201201

202-
Monitor → Analyze → Improve → Release → Validate → Monitor
202+
* Monitor → Analyze → Improve → Release → Validate → Monitor
203203

204204
## References
205205

206-
[https://learn.microsoft.com/en-us/microsoft-copilot-studio/authoring-solutions-overview#create-and-manage-solution-pipelines](/microsoft-copilot-studio/authoring-solutions-overview)
206+
[https://learn.microsoft.com/microsoft-copilot-studio/authoring-solutions-overview#create-and-manage-solution-pipelines](/microsoft-copilot-studio/authoring-solutions-overview)
207207

208-
[https://learn.microsoft.com/en-us/training/paths/extend-microsoft-365-copilot-connectors-visual-studio-code/](/training/paths/extend-microsoft-365-copilot-connectors-visual-studio-code/)
208+
[https://learn.microsoft.com/training/paths/extend-microsoft-365-copilot-connectors-visual-studio-code/](/training/paths/extend-microsoft-365-copilot-connectors-visual-studio-code/)
209209

210-
[https://learn.microsoft.com/en-us/microsoft-copilot-studio/guidance/architecture/deployment-lifecycle](/microsoft-copilot-studio/guidance/architecture/deployment-lifecycle)
210+
[https://learn.microsoft.com/microsoft-copilot-studio/guidance/architecture/deployment-lifecycle](/microsoft-copilot-studio/guidance/architecture/deployment-lifecycle)
211211

212-
[https://learn.microsoft.com/en-us/microsoft-copilot-studio/authoring-solutions-overview](/microsoft-copilot-studio/authoring-solutions-overview)
212+
[https://learn.microsoft.com/microsoft-copilot-studio/authoring-solutions-overview](/microsoft-copilot-studio/authoring-solutions-overview)

learn-pr/wwl/design-alm-process-ai-powered-business-solutions/includes/4-design-alm-process-microsoft-foundry-agents.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -110,7 +110,7 @@ Foundry agents rely on data retrieved from controlled environments. ALM must enf
110110

111111
* **Use of secure identity management for agent actions**
112112

113-
A centralized governance strategy ensures consistency and reduces operational risk.
113+
* A centralized governance strategy ensures consistency and reduces operational risk.
114114

115115
## Deployment and release management
116116

0 commit comments

Comments
 (0)