Skip to content

Commit 47ac0d9

Browse files
committed
Bullet fix for Agent usage page
1 parent 56d1110 commit 47ac0d9

1 file changed

Lines changed: 47 additions & 47 deletions

File tree

learn-pr/wwl/analyze-monitor-tune-ai-powered-business-solutions/includes/3-analyze-backlog-user-feedback-ai-agent-usage.md

Lines changed: 47 additions & 47 deletions
Original file line numberDiff line numberDiff line change
@@ -8,43 +8,43 @@ Solution architects play a critical role in translating insights from telemetry,
88

99
### A backlog in AI and agent operations typically contains:
1010

11-
Enhancement requests
11+
* Enhancement requests
1212

13-
Feature gaps
13+
* Feature gaps
1414

15-
Recurrent issues or failure modes
15+
* Recurrent issues or failure modes
1616

17-
Userreported friction
17+
* Userreported friction
1818

19-
Operational risks
19+
* Operational risks
2020

21-
Governance or policy misalignment concerns
21+
* Governance or policy misalignment concerns
2222

2323
### User feedback may originate from:
2424

25-
Conversation transcripts
25+
* Conversation transcripts
2626

27-
Agent usage analytics
27+
* Agent usage analytics
2828

29-
Support tickets
29+
* Support tickets
3030

31-
Internal surveys
31+
* Internal surveys
3232

33-
Inapp rating prompts
33+
* Inapp rating prompts
3434

35-
Observability dashboards
35+
* Observability dashboards
3636

3737
### Effective backlog analysis helps solution architects:
3838

39-
Prioritize improvements based on impact
39+
* Prioritize improvements based on impact
4040

41-
Classify themes and detect emerging patterns
41+
* Classify themes and detect emerging patterns
4242

43-
Understand user sentiment and expectations
43+
* Understand user sentiment and expectations
4444

45-
Validate whether agent behavior aligns to business intent
45+
* Validate whether agent behavior aligns to business intent
4646

47-
Identify opportunities for automation and process redesign
47+
* Identify opportunities for automation and process redesign
4848

4949
## 2. Framework for Backlog Analysis
5050

@@ -54,17 +54,17 @@ Use a structured, repeatable model to elevate analysis to a solutionarchitecture
5454

5555
#### Organize items into categories such as:
5656

57-
**Accuracy and Reasoning**: Incorrect, missing, or lowconfidence responses
57+
* **Accuracy and Reasoning**: Incorrect, missing, or lowconfidence responses
5858

59-
**Knowledge Issues**: Outdated content, insufficient grounding sources
59+
* **Knowledge Issues**: Outdated content, insufficient grounding sources
6060

61-
**Performance**: Slow response times, timeouts, high latency
61+
* **Performance**: Slow response times, timeouts, high latency
6262

63-
**User Experience**: Confusing prompts, unclear flows, poor guidance
63+
* **User Experience**: Confusing prompts, unclear flows, poor guidance
6464

65-
**Integration Issues**: API failures, connector limits, data access problems
65+
* **Integration Issues**: API failures, connector limits, data access problems
6666

67-
**Governance and Compliance**: Guardrail triggers, DLP conflicts, restricted actions
67+
* **Governance and Compliance**: Guardrail triggers, DLP conflicts, restricted actions
6868

6969
#### Backlog Categorization Table
7070

@@ -87,15 +87,15 @@ Use a matrix to classify items based on business impact and required effort.
8787

8888
#### Solution architects should analyze:
8989

90-
Frequency of similar feedback (volume signals)
90+
* Frequency of similar feedback (volume signals)
9191

92-
Severity of user-reported issues
92+
* Severity of user-reported issues
9393

94-
Sentiment indicators in transcripts
94+
* Sentiment indicators in transcripts
9595

96-
Missed expectations versus business workflows
96+
* Missed expectations versus business workflows
9797

98-
Suggestions for improving agent guidance
98+
* Suggestions for improving agent guidance
9999

100100
#### User Feedback Funnel
101101

@@ -106,49 +106,49 @@ Suggestions for improving agent guidance
106106

107107
### Conversation transcripts reveal:
108108

109-
Where the agent misunderstood intent
109+
* Where the agent misunderstood intent
110110

111-
Where users abandoned a flow
111+
* Where users abandoned a flow
112112

113-
Incorrect reasoning steps
113+
* Incorrect reasoning steps
114114

115-
Missing knowledge content
115+
* Missing knowledge content
116116

117-
Workflows requiring human intervention
117+
* Workflows requiring human intervention
118118

119119
### Solution architects should:
120120

121-
Extract common failure paths
121+
* Extract common failure paths
122122

123-
Map transcript patterns to root causes
123+
* Map transcript patterns to root causes
124124

125-
Identify training or knowledge updates needed
125+
* Identify training or knowledge updates needed
126126

127-
Recommend guardrail adjustments or action limits
127+
* Recommend guardrail adjustments or action limits
128128

129-
Agent Improvement Plan
129+
* Agent Improvement Plan
130130

131131
## 4. Monitoring Agent Usage and Behavior
132132

133-
Monitoring ensures agents operate as intended and scale properly.
133+
* Monitoring ensures agents operate as intended and scale properly.
134134

135135
### Key items for architects to monitor:
136136

137-
Usage trends and adoption
137+
* Usage trends and adoption
138138

139-
Peak usage periods
139+
* Peak usage periods
140140

141-
Most triggered intents
141+
* Most triggered intents
142142

143-
High-failure prompts
143+
* High-failure prompts
144144

145-
Actions invoked per session
145+
* Actions invoked per session
146146

147-
Guardrail intervention events
147+
* Guardrail intervention events
148148

149-
Data access denials
149+
* Data access denials
150150

151-
Performance and latency
151+
* Performance and latency
152152

153153
### Agent Health Summary Table
154154

0 commit comments

Comments
 (0)