Features

TestNG Automated App Testing

See our TestNG example repository for a simple example on how to run TestNG mobile app tests.

Install Dependencies

First, make sure you install the necessary dependencies to run a test.

<!-- Install using maven -->
<dependency>
    <groupId>org.testng</groupId>
    <artifactId>testng</artifactId>
    <version>7.1.0</version>
</dependency>

TestNG Example

Please see the example below. We're going to test our sample app on a Real Device.
In this test we'll add values to two input fields and see if the calculator works.


public class SingleTest extends TestingBotTestNGTest {
  @Test
  public void test() throws Exception {
    AndroidElement inputA = (AndroidElement) new WebDriverWait(driver, 30).until(
	    ExpectedConditions.elementToBeClickable(MobileBy.AccessibilityId("inputA")));
	inputA.sendKeys("10");
	AndroidElement inputB = (AndroidElement) new WebDriverWait(driver, 30).until(
	    ExpectedConditions.elementToBeClickable(MobileBy.AccessibilityId("inputB")));
	inputB.sendKeys("5");
	Thread.sleep(5000);

	AndroidElement sum = (AndroidElement) new WebDriverWait(driver, 30).until(
	    ExpectedConditions.elementToBeClickable(MobileBy.AccessibilityId("sum")));
	Assert.assertEquals(sum.getText(), "15");
  }
}
public class SingleTest extends TestingBotTestNGTest {
  @Test
  public void test() throws Exception {
    IOSElement inputA = (IOSElement) new WebDriverWait(driver, 30).until(
	    ExpectedConditions.elementToBeClickable(MobileBy.AccessibilityId("inputA")));
	inputA.sendKeys("10");
	IOSElement inputB = (IOSElement) new WebDriverWait(driver, 30).until(
	    ExpectedConditions.elementToBeClickable(MobileBy.AccessibilityId("inputB")));
	inputB.sendKeys("5");
	Thread.sleep(5000);

	IOSElement sum = (IOSElement) new WebDriverWait(driver, 30).until(
	    ExpectedConditions.elementToBeClickable(MobileBy.AccessibilityId("sum")));
	Assert.assertEquals(sum.getText(), "15");
  }
}

TestingBotTestNGTest

Please create a class called TestingBotTestNGTest:

public class TestingBotTestNGTest {
  public WebDriver driver;
 
  @BeforeMethod(alwaysRun=true)
  @org.testng.annotations.Parameters(value={"config", "environment"})
  public void setUp(String config_file, String environment) throws Exception {
      JSONParser parser = new JSONParser();
      JSONObject config = (JSONObject) parser.parse(new FileReader("src/test/resources/conf/" + config_file));
      JSONObject envs = (JSONObject) config.get("environments");
 
      DesiredCapabilities capabilities = new DesiredCapabilities();
 
      Map envCapabilities = (Map) envs.get(environment);
      Iterator it = envCapabilities.entrySet().iterator();
      while (it.hasNext()) {
        Map.Entry pair = (Map.Entry)it.next();
        capabilities.setCapability(pair.getKey().toString(), pair.getValue().toString());
      }
        
      Map commonCapabilities = (Map) config.get("capabilities");
      it = commonCapabilities.entrySet().iterator();
      while (it.hasNext()) {
        Map.Entry pair = (Map.Entry)it.next();
        if(capabilities.getCapability(pair.getKey().toString()) == null){
            capabilities.setCapability(pair.getKey().toString(), pair.getValue().toString());
        }
      }
 
      String key = System.getenv("TESTINGBOT_KEY");
      if (key == null) {
        key = (String) config.get("key");
      }
 
      String secret = System.getenv("TESTINGBOT_SECRET");
      if(secret == null) {
        secret = (String) config.get("secret");
      }

      String app = System.getenv("TESTINGBOT_APP_ID");
      if (app != null && !app.isEmpty()) {
        capabilities.setCapability("app", app);
      }
 
      driver = new AndroidDriver(new URL("http://"+key+":"+secret+"@hub.testingbot.com/wd/hub"), capabilities);
  }
 
  @AfterMethod(alwaysRun=true)
  public void tearDown() throws Exception {
    driver.quit();
  }
}

Preparing Your App

Please see our Prepare Mobile App documentation to make sure your app will work on our emulators/devices.

Uploading Your App

Please see our Upload Mobile App documentation to find out how to upload your app to TestingBot for testing.

Configuring capabilities

Please see our example Github project on how to configure your desired capabilities with our example TestingBotJUnitTest.java.

{
  "server": "hub.testingbot.com",
  "key": "TESTINGBOT_KEY",
  "secret": "TESTINGBOT_SECRET",

  "capabilities": {
    "build": "junit-testingbot",
    "name": "single_test"
  },

  "environments": [{
    "app": "https://testingbot.com/appium/sample.apk",
    "platformName": "Android",
    "version": "9.0",
    "deviceName": "Galaxy S10"
  }]
}

Specifying the operating system, browser and version

To let TestingBot know on which browser/platform you want to run your test on, you need to specify the browsername, version, OS and other optional options in the capabilities field.


{
    "app": "https://testingbot.com/appium/sample.apk",
    "platformName": "Android",
    "version": "9.0",
    "deviceName": "Galaxy S10"
}

To see how to do this please select a combination of browser version and platform in the drop-down menus below


1. Select an OS
2. Select a device


Testing Internal/Staged Websites

We've built TestingBot Tunnel, to provide you with a secure way to run tests against your staged/internal webapps.
Please see our TestingBot Tunnel documentation for more information about this easy to use tunneling solution.


The example below shows how to easily run a JUnit WebDriver test with our Tunnel:


1. Download our tunnel and start the tunnel:

java -jar testingbot-tunnel.jar key secret

2. Adjust your test: instead of pointing to 'hub.testingbot.com/wd/hub' like the example above - change it to point to your tunnel's IP address.
Assuming you run the tunnel on the same machine you run your tests, change to 'localhost:4445/wd/hub'. localhost is the machine running the tunnel, 4445 is the default port of the tunnel.


This way your test will go securely through the tunnel to TestingBot and back:


{
  "server": "localhost:4445",
  "key": "TESTINGBOT_KEY",
  "secret": "TESTINGBOT_SECRET",

  "capabilities": {
    "build": "junit-testingbot",
    "name": "single_test"
  },

  "environments": [{
    "app": "https://testingbot.com/appium/sample.apk",
    "platformName": "Android",
    "version": "9.0",
    "deviceName": "Galaxy S10"
  }]
}

Other Options

We offer many other test options, for example: disable video recording, uploading files, ...
See our list of test options for a full list of options to customize your tests.