Features

BDD with Python, Behave and WebDriver

See our Behave example repository for a simple example on how to run Behave tests in parallel on TestingBot.

Behave is a Python BDD plugin which makes it easy to write tests in a natural language style.
To get started, make sure you have installed Behave:

$ sudo pip install behave


You are now ready to create your first story and run it on our Selenium grid.
Run the test with:

$ behave


Example feature (features/google.feature)

Feature: testing google

Scenario: visit google and check
When we visit google
Then it should have a title "Google"

Example steps (features/steps/steps.py)

@when('we visit google')
def step(context):
   context.browser.get('http://www.google.com')

@then('it should have a title "Google"')
def step(context):
   assert context.browser.title == "Google"

Example features/environment.py

from selenium import webdriver

def before_all(context):
	desired_capabilities = webdriver.DesiredCapabilities.FIREFOX
	desired_capabilities['version'] = 'latest'
	desired_capabilities['platform'] = 'WINDOWS'
	desired_capabilities['name'] = 'Testing Selenium with Behave'
	desired_capabilities['client_key'] = 'key'
	desired_capabilities['client_secret'] = 'secret'

	context.browser = webdriver.Remote(
		desired_capabilities=desired_capabilities,
		command_executor="https://hub.testingbot.com/wd/hub"
	)

def after_all(context):
	context.browser.quit()

Configuring capabilities

To let TestingBot know on which browser/platform you want to run your test on, you need to specify the browsername, version, OS and other optional options in the capabilities field.



Before
driver = webdriver.Firefox()

After
driver = webdriver.Remote(
  command_executor='https://key:secret@hub.testingbot.com/wd/hub',
  desired_capabilities=desired_caps)

To see how to do this, please select a combination of browser, version and platform in the drop-down menus below:


1. Select a Platform
2. Select a Browser


Testing Internal/Staged Websites

We've built TestingBot Tunnel, to provide you with a secure way to run tests against your staged/internal webapps.
Please see our TestingBot Tunnel documentation for more information about this easy to use tunneling solution.


The example below shows how to easily run a Behave WebDriver test with our Tunnel:


1. Download our tunnel and start the tunnel:

java -jar testingbot-tunnel.jarkey secret

2. Adjust your test: instead of pointing to hub.testingbot.com/wd/hub like the example above - change it to point to your tunnel's IP address.
Assuming you run the tunnel on the same machine you run your tests, change to localhost:4445/wd/hub. localhost is the machine running the tunnel, 4445 is the default port of the tunnel.


This way your test will go securely through the tunnel to TestingBot and back:


Example features/environment.py

from selenium import webdriver

def before_all(context):
	desired_capabilities = webdriver.DesiredCapabilities.FIREFOX
	desired_capabilities['version'] = 'latest'
	desired_capabilities['platform'] = 'WINDOWS'
	desired_capabilities['name'] = 'Testing Selenium with Behave'
	desired_capabilities['client_key'] = 'key'
	desired_capabilities['client_secret'] = 'secret'

	context.browser = webdriver.Remote(
		desired_capabilities=desired_capabilities,
		command_executor="http://localhost:4445/wd/hub"
	)

def after_all(context):
	context.browser.quit()

Other Options

We offer many other test options, for example: disable video recording, specifying a custom Firefox Profile, loading Chrome/Firefox/Safari extensions, running an executable before your test starts, uploading files, ...
See our list of test options for a full list of options to customize your tests.

Reporting Test Results

As TestingBot has no way to dermine whether your test passed or failed (it is determined by your business logic), we offer a way to send the test status back to TestingBot. This is useful if you want to see if a test succeeded or failed from the TestingBot member area.


You can use our Python API client to report back test results.

tb = testingbotclient.TestingBotClient(key, secret)
tb.tests.update_test(context.browser.session_id, status_message=.., passed=1|0, build=.., name=..)

Pick a Python Test Framework

  • PyTest

    PyTest makes it easy to run Selenium tests with Python.

  • Lettuce

    Lettuce is a Python BDD plugin based on Ruby's Cucumber, offering Gherkin stories.

  • PyUnit

    PyUnit is the standard unit testing framework module for Python, described as a Python version of JUnit.