Sikuli uses image recognition to identify components you want to interact with on the screen.
While Selenium is limited to interacting with browsers, Sikuli can be used to interact with native GUI components (for example: Windows dialogs, Linux programs or OS-X GUI).
At TestingBot, all our VMs are able to run your Sikuli scripts.
1. Download and setup Sikuli
To get started, please download Sikuli.
Once downloaded, run the file to install Sikuli.
2. Create a new Sikuli script
Sikuli uses image-recognition to find the components to interact with.
In this example, we'll take a screenshot of a Chrome dialog asking to install a Chrome extension.
3. The Sikuli script
As you can see on the screenshot above, you can use wait([image], FOREVER) to have Sikuli wait for something to appear on the screen that looks like the [image].
Once this happens, Sikuli will move on to the next step in the script: clicking the component it detected.