Get details of a UI element in window Action(Power Automate Desktop)

Japanese version.

This action retrieves information about a UI element (button, text box, etc.).

The information that can be retrieved includes.

  • The text displayed on the UI element.
  • Whether the UI element is visible or not.
  • The position and size of the UI element.
  • Whether the UI element is valid or not.

How to use

From "Actions", "UI Automation", "Data extraction", Drag "Get details of a UI element in window".

Set parameters.

Parameter

UI element

Specifies the UI element for which information is to be retrieved.

The following pops up when you click on the input field.

If you have already registered a UI element, select the object,If not registered, click the "Add UI element" button.

Hover the mouse over the menu item you wish to select when the next window appears.

When you hover the mouse over it, it will be surrounded by a red frame.

Then hold down the Ctrl key and click.

The input field should appear as shown in the following figure (the text will vary depending on the UI element you have selected).

Attribute name

Selects which information is retrieved from the UI element.

SelectDescription
Own TextText displayed on UI elements.
ExistsIs UI element present?
- Exists…True
- Does not exist…False
Location and SizePosition and size of the UI element.
Get the position and size of the UI element as comma-separated text: "horizontal position, vertical position, width, height".
EnabledIs UI element valid?
- Enabled…True
- Disabled…False

Variables produced

AttributeValue

The specified information is stored.

If "Location and Size" is set to "AttributeName," the location and size of the UI element is obtained as comma-separated text: horizontal position, vertical position, width, and height.

You will often use "Split text" for comma delimitation.

Example of "Split text" result.

To use individual information, specify the following.

InformationVariable
Horizontal position%TextList[0]%
Vertical position%TextList[1]%
Width%TextList[2]%
Height%TextList[3]%

Since the individual information is text, it cannot be used in calculations as is.

If you wish to use the information for calculation, convert it to numerical values using "Convert text to number".

For those who want to learn Power Automate Desktop effectively


The information on this site is now available in an easy-to-read e-book format.

Or Kindle Unlimited (unlimited reading).

You willl discover how to about basic operations.

By the end of this book, you will be equipped with the knowledge you need to use Power Automate Desktop to streamline your workflow.

Table of Contents.

Update History.

Links

UI automation Actions