UI automation(Power Automate Desktop Action)

07/16/2023

Japanese version.

This function is related to the operation of Windows applications.
Window operations and input form operations.

Actions

NameImportanceDescription
If window containsMiddleThis action is a companion to the "If" action, which branches processing conditional on the presence of the specified element or text in the window.
Wait for window contentHighAn action that waits for a flow conditional on the presence of a specified UI element or text in the window.
This is useful when it takes a long time for a UI element or text to appear.
If imageMiddleThis action is a companion to the "If" action and branches processing conditional on the presence or absence of an image.
Use desktopHighThe action is to click on an object on the desktop or the taskbar.
Select tab in windowMiddleThis action selects a tab in a Windows application.
This action is not available for browser tabs.
Wait for imageHighConditional on the presence of the specified screen in the window.
This action waits for the flow.
This is useful when it takes a long time for a screen to appear.
Hover mouse over UI element in windowMiddleMouse over the specified object in Windows.
Click UI element in windowHighClick on the designated object in Windows.
Select menu option in windowHighSelect the menu item for the application.
Drag and drop UI element in windowMiddleIt can be used to move files (although Move file(s) Action also exists) or to open a specified file in a specified application.
Expand/collapse tree node in windowLowExpand or collapse the node in the tree view that selects the file/directory.
If windowHighThis action is a companion to the "If" action and branches processing based on the status of the target window.
Window statuses include "open/closed" and "focused/not focused.
Wait for windowHighThis action waits for a flow conditional on the state of the specified window.
This is useful when it takes a long time for a window to appear.

Data extraction

NameImportanceDescription
Get details of windowMiddleThis action retrieves information about the specified window.
The following information can be obtained.
Title / Text / Location and size / Process name
Get details of a UI element in windowHighThis action retrieves information about a UI element (button, text box, etc.).
The information that can be retrieved includes.
- The text displayed on the UI element.
- Whether the UI element is visible or not.
- The position and size of the UI element.
- Whether the UI element is valid or not.
Get selected checkboxes in windowHighThis action acquires the status (ON/OFF) of a check box.
Get selected radio button in windowHighThis action obtains the status (ON/OFF) of a radio button.
Extract data from windowHighThis action retrieves data from a table (DataGrid) or list (List) in a Windows application.
The result will be a List, Data table, or Excel format.
Take screenshot of UI elementMiddleThis action saves a screenshot of the specified UI element to the clipboard or a file.
The target is the UI element in the window, not the window itself.
If you want to take a screenshot of a window or screen, If you want to take a screenshot of a window or screen, use "Take screenshot" under "Workstation".

Form filling

NameImportanceDescription
Focus text field in windowMiddleThis action focuses the text input field of a Windows application.
Populate text field in windowHighThis action enters a specified value into a text input field in a Windows application.
Press button in windowHighPress the specify button.
Select radio button in windowHighThis action is to press the specified radio button in the Windows application.
If the target state is already ON, it will remain ON even if you press it again.
Set checkbox state in windowHighThis action presses (turns on/off) a specified check box in a Windows application.
Set drop-down list value in windowHighSet the Windows ApplicSet the Windows Application drop-down list to a value.ation drop-down list to a value.

Windows

NameImportanceDescription
Get windowHighMake the window a variable for use in other actions.
Focus windowHighThis action brings the specified window to the foreground.
Set window stateHighThis action changes the state (normal, maximized, or minimized) of the specified window.
Set window visibilityHighThis action changes the show/hide status of the specified window.
Move windowMiddleThis action changes the position of the specified window.
Resize windowMiddleThis action changes the size of the specified window.
Close windowHighThis action closes an open window.