Scale Locust tests without building the infrastructure

Bring your existing Locust tests and let Testable provision distributed workers, aggregate results in real time, capture traces, and automate release-ready success criteria across cloud or private infrastructure.

Locust logo surrounded by Testable icons for scripts, configuration, reports, results files, and cloud upload

Trusted by

  • Pivotal
  • UBS
  • Adidas
  • Mastercard
  • Deutsche Bank
  • TP ICAP
  • RBS
concurrent users
Million+
test regions
100+
tools
17+
protocols
50+
browser, OS, and device combinations
2000+

Why Testable Cloud vs roll your own?

Testable adds API, test setup, execution, reporting, analysis, and collaboration features on top of what you get from Locust out of the box.

Locust web UI statistics for a running test with 6 workers, beside a locustfile defining a WebsiteUser that logs in and requests the home, assets, and about pages

Easy to bring both simple and complex test scenarios

Either upload a zip file with all your locustfiles and other required artifacts (for example, CSVs) to Testable, or link Testable with your git repository. The git repo does not have to be publicly accessible or even hosted on a public git service. If you link Testable with git we will clone your repo onto each Locust engine at test execution time.

If your test includes a requirements.txt file, those modules are also installed on each Locust engine automatically, either from PyPI or your own artifact repository.

Table of cloud test runner instances, each with its region, instance type, and status

Infinitely scalable distributed Locust engines

Run a distributed test with as many Locust engines as your tests require without a master node becoming the processing bottleneck.

Testable does not rely on Locust's master/worker technology. Testable's proprietary distributed grid runs each Locust engine independently. Each test runner reports results via a highly efficient binary protocol to a scalable test processing service that aggregates them together for real-time reporting and analysis.

World map with pins marking test runner regions across North America, South America, Europe, Africa, Asia, and Australia

Automated Locust engine provisioning across the globe

  • Run your test across 100+ cloud regions on AWS, Azure, and Google Cloud or on-premises.
  • Test runners can be automatically spun up at the start of your test and terminated at the end. Alternatively set up long running test runner grids to run multiple tests.
  • Automated infrastructure spun up in our cloud accounts or yours. Simply grant us enough access and we automate the rest. Non-public applications inside your private network can be tested with zero infrastructure setup before the test.
  • For on-prem, spin up our self-host test runners on any Docker or Kubernetes enabled infrastructure. No connection IN from Testable to the test runner container is required.

Integrate into your continuous integration and deployment pipelines

  • We provide examples of how to integrate Testable as a GitHub Action, into your GitLab pipeline, AWS CodePipeline, Jenkins, and more.

  • Define success criteria to automate the determination of test success allowing you to confidently insert Testable into your continuous deployment pipelines.

Capture useful information not included in standard Locust reports

All charts, metrics, and aggregations available in Locust reports are also available on Testable. We also capture several additional items:

A full trace includes all metrics, and a timeline view of the request that includes all request and response headers and body. Testable intelligently samples to ensure you have at least one example for every combination of URL and response code, but without capturing so many traces that it affects the test performance. Having these traces can be really useful to analyze and debug application errors.

Trace list filtered to sampled requests, above the trace details for one request with its summary, request and response headers, and a timeline

Real-time, aggregated, customizable, shareable reporting across Locust engines

  • View and customize test reports for a test run or a test history. See metrics, charts, trends, anomalies, videos, screenshots, traces, assertions, and more. Drill down by region, target URL, and more. Use the report to deep dive and debug issues.

  • Generate a comparison report between any two test results to see exactly what changed.

  • Mark a specific test run as the baseline (the gold standard) that all other runs are compared against to detect anomalies.

Generate a share link or export your report to PDF, CSV, or JSON.

Success criteria results with observed values checked against conditions such as response time 95th percentile at or below 500 ms and response time median at or below 50%

Success criteria and notifications

Set your criteria for test success in a variety of ways. Some examples include:

  • 95th percentile response time < 500ms
  • Bandwidth utilization is no more than 25% above the baseline run
  • Success rate > 99%
  • Median response time does not spike minute over minute

Success criteria can be evaluated at the end of the test or actively during the test, stopping on failure.

Get notified via email, SMS, and WhatsApp when a test starts, succeeds, and/or fails. Customize notifications as required.

Isometric illustration of a laptop connected to server racks and a cloud

All the enterprise ready features your team expects

Our enterprise features include Single Sign On (SAML), entitlements, multiple team onboarding, 24/7 customer support, professional services, customer encryption keys for test data, and more.