Azure Devops (VSTS)

Azure Devops (formerly Team Foundation Server and Visual Studio Team System) is a CI service owned by Microsoft.

TestingBot has a Marketplace Extension that offers some features to better integrate TestingBot with Azure Devops:

  • Set TestingBot environment variables (TB_KEY and TB_SECRET) to be used by your tests.
  • Embed overview of your tests in Azure Devops.
  • Start/Stop TestingBot Tunnel for specific builds.


1. Go to to Visual Studio Marketplace and download the TestingBot extension.

2. Configure the TestingBot credentials to be used with this extension:

  • Go to Project Settings, under the Pipelines section, select Service connections.
    Create a new Service Connection, choose TestingBot credentials and enter your username (TestingBot API Key) and password (TestingBot API Secret).
    Enter https://api.testingbot.com/v1/ in the Server URL.

3. In your azure-pipelines.yml, add the TestingBot Configuration task. Select the credentials you've added before.
Optionally, you can choose to enable TestingBot Tunnel with this build.

4. Make sure to set the build capability for your tests to be identical to the build identifier generated by Azure Devops. You can get this value through the environment variable TB_BUILD_NAME

5. When the build is complete, you will see a TestingBot tab. This will show an overview of the tests for this build.