Does Microsoft UI Automation Framework work with Chrome, Python and Java Apps?

Question

I am working on an automation project, in which I need to capture the activities [ application launched, data entered, input type etc.] user performs on a desktop. I came ac

Answer 1

Some additions to Simon's answer...

Chrome page content can be seen by UIA if you run chrome --force-renderer-accessibility. Only for existing Chrome process it won't work. Though user can create a new tab chrome://accessibility manually and enable UIA for all or some chosen pages. This method also works for AT-SPI accessibility technology on Linux. Of course, Selenium WebDriver is an industry standard here. But another way exists. Both Mozilla and IE support UIA by default.

Inspect.exe can be simply downloaded from this GitHub repo.

Regarding Java apps it depends on the app type. Your chances is about 50/50.

WxPython or PyQt5 are good for UIA. TkInter or Kivy apps are not.

P.S. There is an example how to drag a file from explorer.exe and drop to Google Drive in Chrome using Python library pywinauto.