You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: support/power-platform/power-automate/desktop-flows/ui-automation/elementpicker-cannot-see-elements.md
+17-17Lines changed: 17 additions & 17 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,58 +6,58 @@ ms.custom: sap:Desktop flows\UI or browser automation
6
6
ms.reviewer: iomimtso, nimoutzo, v-shaywood
7
7
---
8
8
9
-
# UI element picker or Recorder cannot view UI elements in desktop applications
9
+
# UI element picker or recorder can't view UI elements in desktop applications
10
10
11
-
This article provides troubleshooting guidance for an issue that can occur where Power Automate for desktop cannot view or interact with specific UI elements in a desktop application.
11
+
This article provides troubleshooting guidance for an issue where Power Automate for desktop can't view or interact with specific UI elements in a desktop application.
12
12
13
13
## Symptoms
14
14
15
-
When using Power Automate for desktop, the element picker tool cannot detect or "see" certain UI elements within desktop applications. This issue prevents you from selecting elements for automation tasks.
15
+
When using Power Automate for desktop, the element picker tool can't detect or "see" certain UI elements within desktop applications. This issue prevents you from selecting elements for automation tasks.
16
16
17
17
## Cause
18
18
19
-
Some desktop applications use custom UI frameworks or rendering methods that aren't compatible with the standard accessibility APIs that Power Automate for desktop relies on. This can make certain elements invisible to the element picker.
19
+
Some desktop applications use custom UI frameworks or rendering methods that aren't compatible with the standard accessibility APIs that Power Automate for desktop relies on. This incompatibility can make certain elements invisible to the element picker.
20
20
21
21
> [!IMPORTANT]
22
22
> For coordinate-based solutions (Solutions [3](#solution-3-use-the-recorder-with-coordinates) and [4](#solution-4-use-move-mouse-and-send-mouse-click-actions)) to work reliably:
23
23
>
24
24
> - The screen configuration (resolution, DPI settings, scaling) must remain static at runtime and match the configuration used during development.
25
-
> - Changes to the application's user interface structure may affect the effectiveness of these workarounds.
25
+
> - Changes to the application's user interface structure might affect the effectiveness of these workarounds.
26
26
> - Test your flows thoroughly when deploying to different machines or environments.
27
27
28
28
## Solution 1: Use Move mouse to image action
29
29
30
30
1. Add a **Move mouse to image** action to your flow.
31
-
2. Capture an image of the UI element you want to interact with.
32
-
3. Enable the **Send a click after moving mouse** option.
33
-
4. Configure any additional settings as needed.
31
+
1. Capture an image of the UI element you want to interact with.
32
+
1. Enable the **Send a click after moving mouse** option.
33
+
1. Configure any additional settings as needed.
34
34
35
35
This action moves the mouse to the first occurrence of the specified image and sends a left click.
36
36
37
37
## Solution 2: Use Move mouse to text on screen (OCR) action
38
38
39
39
1. Add a **Move mouse to text on screen (OCR)** action to your flow.
40
-
2. Specify the text that appears on or near the UI element you want to interact with.
41
-
3. Enable the **Send a click after moving mouse** option.
42
-
4. Configure OCR settings and click options as needed.
40
+
1. Specify the text that appears on or near the UI element you want to interact with.
41
+
1. Enable the **Send a click after moving mouse** option.
42
+
1. Configure OCR settings and click options as needed.
43
43
44
44
This action uses Optical Character Recognition (OCR) to locate text on the screen or foreground window and sends a mouse click to that location.
45
45
46
46
## Solution 3: Use the recorder with coordinates
47
47
48
48
1. Open Power Automate for desktop and create a new flow.
49
-
2. Select **Recorder** from the toolbar.
50
-
3. Start recording and perform the click action on the desired UI element in your desktop application.
51
-
4. Stop the recording.
49
+
1. Select **Recorder** from the toolbar.
50
+
1. Start recording and perform the click action on the desired UI element in your desktop application.
51
+
1. Stop the recording.
52
52
53
53
The recorder creates a **Click UI element in window** action with coordinate-based input parameters populated with the respective values from your click action.
54
54
55
55
## Solution 4: Use Move mouse and Send mouse click actions
56
56
57
57
1. Add a **Move mouse** action to your flow.
58
-
2. Configure the action to move the mouse to the specific coordinates of the target element.
59
-
3. Add a **Send mouse click** action immediately after the Move mouse action.
60
-
4. Configure the Send mouse click action to perform the desired click (left, right, or double-click).
58
+
1. Configure the action to move the mouse to the specific coordinates of the target element.
59
+
1. Add a **Send mouse click** action immediately after the Move mouse action.
60
+
1. Configure the Send mouse click action to perform the desired click (left, right, or double-click).
0 commit comments