Does Microsoft UI Automation Framework work with Chrome, Python and Java Apps?

Question

I am working on an automation project, in which I need to capture the activities [ application launched, data entered, input type etc.] user performs on a desktop. I came ac

Answer 1

I'm a bit late to the party.. But Chromes accessibility features are only activated once something tries to access it's accessibility.

If you call AccessibleObjectFromWindow ([DllImport("oleacc.dll")]) with the window handle an existing chrome window will have its accessibility activated (and you'll see the actual web page content in UIA!).

If the chrome window is opened after your app is running - Chrome pings open processes for any open accessibility apps... for that you use AccessibleObjectFromEvent and the event you're responding to comes from the windows pipeline: EVENT_SYSTEM_ALERT = 0x0002 .

The bottom line is - you have to tell chrome that there's something installed that wants to access it's web page content.

Oh! and your application has to be signed!! Unsigned apps won't be able to access web content - I think that's the same in firefox too.

I hope this helps someone in the future.

See: https://www.chromium.org/developers/design-documents/accessibility