You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: learn-pr/wwl/manage-testing-ai-powered-business-solutions/7-knowledge-check.yml
+9-9Lines changed: 9 additions & 9 deletions
Original file line number
Diff line number
Diff line change
@@ -13,15 +13,15 @@ durationInMinutes: 3
13
13
content: "Choose the best response for each of the following questions."
14
14
quiz:
15
15
questions:
16
-
- content: "Which statement best explains why traditional software testing is not sufficient for AI-powered business solutions?"
16
+
- content: "Which statement best explains why traditional software testing isn't sufficient for AI-powered business solutions?"
17
17
choices:
18
18
- content: "AI solutions require more UI automation than traditional apps."
19
19
isCorrect: false
20
-
explanation: "Incorrect. While UI automation may be part of testing, it does not address the unique challenges of AI systems."
20
+
explanation: "Incorrect. While UI automation may be part of testing, it doesn't address the unique challenges of AI systems."
21
21
- content: "AI outputs are probabilistic and can vary based on context, data, and input phrasing."
22
22
isCorrect: true
23
-
explanation: "Correct. AI models produce probabilistic, context-dependent outputs. Two similar inputs can generate different results depending on data grounding, prompt variations, or system state. This variability requires new testing approaches that validate behavior patterns, safety, guardrails, grounding integrity, and consistency—areas traditional deterministic software testing does not fully cover."
24
-
- content: "AI systems do not require validation of compliance or safety."
23
+
explanation: "Correct. AI models produce probabilistic, context-dependent outputs. Two similar inputs can generate different results depending on data grounding, prompt variations, or system state. This variability requires new testing approaches that validate behavior patterns, safety, guardrails, grounding integrity, and consistency—areas traditional deterministic software testing doesn't fully cover."
24
+
- content: "AI systems don't require validation of compliance or safety."
25
25
isCorrect: false
26
26
explanation: "Incorrect. AI systems often require rigorous validation for compliance and safety, especially in regulated industries."
27
27
- content: "AI solutions only need to be tested once before deployment."
@@ -31,10 +31,10 @@ quiz:
31
31
choices:
32
32
- content: "Length of the conversation"
33
33
isCorrect: false
34
-
explanation: "Incorrect. Conversation length does not measure the quality or alignment of AI outputs with business outcomes."
34
+
explanation: "Incorrect. Conversation length doesn't measure the quality or alignment of AI outputs with business outcomes."
35
35
- content: "Number of users interacting with the AI"
36
36
isCorrect: false
37
-
explanation: "Incorrect. While user engagement is important, it does not directly validate the accuracy or relevance of AI outputs."
37
+
explanation: "Incorrect. While user engagement is important, it doesn't directly validate the accuracy or relevance of AI outputs."
38
38
- content: "Accuracy and relevance of the AI's responses"
39
39
isCorrect: true
40
40
explanation: "Correct. To ensure an AI solution is delivering value, you must confirm that the outputs are accurate, relevant, and aligned with business intent. This directly validates whether the AI is producing correct insights or actions that support real business workflows."
@@ -49,9 +49,9 @@ quiz:
49
49
- content: "Because AI output quality depends on consistent, trusted, and well-timed input data from across integrated systems."
50
50
isCorrect: true
51
51
explanation: "Correct. AI decisions depend on data flowing across multiple apps. Workflow orchestration can break when one app changes, data may be duplicated or transformed, and AI output quality relies on consistent, trusted, well-timed input data. Testing must validate the entire business process to ensure accurate outputs."
52
-
- content: "Because testing individual apps is not possible with AI solutions."
52
+
- content: "Because testing individual apps isn't possible with AI solutions."
53
53
isCorrect: false
54
-
explanation: "Incorrect. Individual app testing is still possible, but it does not validate the end-to-end behavior of AI solutions that span multiple systems."
55
-
- content: "Because Dynamics 365 apps cannot share data without manual intervention."
54
+
explanation: "Incorrect. Individual app testing is still possible, but it doesn't validate the end-to-end behavior of AI solutions that span multiple systems."
55
+
- content: "Because Dynamics 365 apps can't share data without manual intervention."
56
56
isCorrect: false
57
57
explanation: "Incorrect. Dynamics 365 apps integrate through connectors, data sync, and automations. The challenge is validating that these integrations work correctly for AI-driven workflows."
Copy file name to clipboardExpand all lines: learn-pr/wwl/manage-testing-ai-powered-business-solutions/includes/1-introduction.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,4 +1,4 @@
1
-
This module introduces solution architects to the essential practices required to validate and maintain the quality of AI-powered business solutions across the enterprise. Because AI systems generate probabilistic outputs and rely on dynamic data sources, traditional testing methods are not sufficient. This module equips learners with the frameworks, metrics, and governance needed to ensure AI solutions behave reliably, safely, and in alignment with business goals.
1
+
This module introduces solution architects to the essential practices required to validate and maintain the quality of AI-powered business solutions across the enterprise. Because AI systems generate probabilistic outputs and rely on dynamic data sources, traditional testing methods aren't sufficient. This module equips learners with the frameworks, metrics, and governance needed to ensure AI solutions behave reliably, safely, and in alignment with business goals.
2
2
3
3
Learners will explore how to design structured testing processes for agents, custom AI models, prompts, and end-to-end multi-application scenarios. Each unit provides practical guidance on defining objectives, creating measurable validation criteria, evaluating safety and compliance, and understanding how data flows across integrated business applications affect AI behavior.
Copy file name to clipboardExpand all lines: learn-pr/wwl/manage-testing-ai-powered-business-solutions/includes/3-create-validation-criteria-custom-ai-models.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -57,7 +57,7 @@ Below are key metrics that must be included in the evaluation of custom AI Model
Copy file name to clipboardExpand all lines: learn-pr/wwl/manage-testing-ai-powered-business-solutions/includes/4-validate-effective-copilot-prompt-best-practices.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -44,7 +44,7 @@ Solution architects validate prompts not as one-off instructions, but as **repea
44
44
45
45
-**Validate constraints** Tone, length, format, exclusions, role, audience.
46
46
47
-
-**Evaluate for safety** Ensure the prompt cannot unintentionally trigger sensitive or restricted actions.
47
+
-**Evaluate for safety** Ensure the prompt can't unintentionally trigger sensitive or restricted actions.
48
48
49
49
-**Run multi-scenario testing** Validate prompt quality across multiple phrasings and user types.
Copy file name to clipboardExpand all lines: learn-pr/wwl/manage-testing-ai-powered-business-solutions/includes/8-summary.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,4 +1,4 @@
1
-
This module equips solution architects with the practices and frameworks required to validate the reliability, safety, and performance of AI-powered business solutions. Learners discover why traditional deterministic testing is not enough for AI systems, which generate variable, context-dependent outputs and require structured evaluation across scenarios, data sources, user inputs, and operational environments.
1
+
This module equips solution architects with the practices and frameworks required to validate the reliability, safety, and performance of AI-powered business solutions. Learners discover why traditional deterministic testing isn't enough for AI systems, which generate variable, context-dependent outputs and require structured evaluation across scenarios, data sources, user inputs, and operational environments.
2
2
3
3
Throughout the module, architects explore how to design repeatable testing processes for AI agents, custom AI models, prompts, and end-to-end workflows across multiple business applications. The content emphasizes measurable performance indicators such as accuracy, latency, stability, grounding integrity, guardrail compliance, and user experience quality. It also introduces modern validation approaches including scenario-based testing, prompt evaluation, and observability metrics.
0 commit comments