Managing Configuration with Environments

An Environment is a group of configuration settings (initial variables, locations, notifications, integrations, etc.) used when running a test. Every test has at least one environment, but you can create additional environments as needed. For common settings (base URLs, API keys) that you'd like to use across all tests within a bucket, use a Shared Environment.

Environments are great for cases when you need to re-use the same set of test steps with different configurations e.g. executing the same test against your local dev version of an API as well as the live production version.

Multi-Environment Test Configuration Example

Here is an example of environment settings for a test that re-uses steps across three different environments: your local dev environment, a staging server, and a production realm.

A comparison of a local, staging, and production environments, and examples of how certain variables like baseURL, apiKey, and other settings can be configured differently for each case.

Select and Manage Environments

The user interface for switching and editing environments.

There are two primary places you will interact with your environment settings: the environments switcher (top right of the test editor) and the environment settings editor (above the test steps in the test editor). The switcher determines the current environment you are working with. When you switch between environments, the values in the settings editor will be updated to reflect the currently selected environment.

The environment switcher is where you create and delete environments. Create an empty environment by selecting Add Environment or alternately select Duplicate to create a copy of an existing one.

Test-specific Environments

Test environments belong to a single test. They can optionally inherit settings from a shared environment, overriding variables and other settings specific to the test. The following settings are included in an environment:

Note: You can have a maximum of 100 local (test-specific) environments per bucket. Once the limit is exceeded, you can no longer add new shared environments.

Shared Environments

Shared environments belong to a bucket and can be used by any test within the same bucket either on their own, or via a test-specific environment set to inherit its settings.

Note: You can have a maximum of 100 shared environments per bucket. Once the limit is exceeded, you can no longer add new shared environments.

Inheriting From Shared Environments

When a test-specific environment is set to inherit from a shared environment, the shared environment is used as a base that the test environment builds on. Depending on the setting, you may be able to override settings in inheriting test environments:

Initial Variables and Initial Scripts

See: Evaluation Order of Initial Variables

Authentication

Authentication settings in the shared environment can be overridden by test environment settings.

Headers

Headers in the shared environment with the same name as those in a test environment will be overridden by those in the inheriting test environment.

Behaviors

Behaviors that have their default values changed in a shared environment cannot be toggled in the inheriting test-environment. Otherwise, they can be toggled On or Off. The default values for behaviors are:

  • Retry on Failure - Off
  • Stop on Failure - Off
  • Use Cookies - Off
  • Validate SSL - On

  • HTTP version support - HTTP/1 only. Can be changed to HTTP/2 only or HTTP/2 compatibility

  • Force h2c - Off

Locations and Agents

Locations and agents that have been enabled in a shared environment cannot be disabled from an inheriting test environment. Additional locations and agents can be enabled for the specific test environment.

Note: You can run API monitoring tests from a private location. Use the Radar agent to bridge BlazeMeter API Monitoring to private APIs not available over the public internet. Note that Radar agent is a wholly separate installation from Private Location agents, and is specific only to BlazeMeter's API monitoring function.

Email Notifications

If email notification settings are specified in a shared environment, inheriting test environments can add to the list of team members to receive notifications, but cannot override the frequency or turn off notifications to team members specified in the shared environment.

Email notifications can be sent to:

Note: Maximum of 200 unique custom email addresses can be added per team.

The Custom emails feature requires a qualifying plan. Check your plan or contact Sales to get started.

Add Custom Email Domains to Email Notification Domain Allowlist

Prerequisites: You must be a team owner.

Follow these steps:

  1. In API Monitoring, click your profile on the top-right and select Teams & Usage.
    The Settings & Usage page opens.
  2. Scroll down to the Email Notification Domain Allowlist section.
  3. Enter a list of domains.
    The team members can use the list when adding custom emails for Email Notifications in Bucket Settings.
    Note: Make sure the domains are comma-separated and without spaces.
  4. Click Add Custom Email Address.
  5. Enter an email address and a description.
  6. Click Save Changes.

Add a Custom Email Address

A team owner can add distribution lists or external email addresses from the Dashboard teams page.

Prerequisites: You must be a team owner.

Follow these steps:

  1. In API Monitoring, click Bucket Settings in the top right corner.
    The Bucket Settings page opens.
  2. Scroll down to the Custom Email Addresses section.
  3. Click Add Custom Email Address.
  4. Enter an email address and a description.
  5. Click Add New Email.

The custom email that you added will show on the test settings page under the custom email notifications column. To send test notifications to the email address that you added, see Configure Email Notifications.

When you add a new email address to a bucket, it will be added at the Bucket level and the Team level. If you then add the same email address to a different bucket, it will be added to that bucket only.

To delete a custom email address from a bucket, go to Bucket Settings, Custom Email Addresses and click the x next to the email that you want to delete. The email will be removed on the bucket level. The email is also deleted from any tests that are in the bucket.

Configure Email Notifications

You can configure email notifications so that test results are sent to custom email addresses (non-member emails, external emails, or distribution list emails).

Prerequisites: You must be a team owner or a user with permissions to modify buckets.

Follow these steps:

  1. In API Monitoring, click Environments on the top right.
    A page with a list of test environments opens.
  2. Click an environment.
  3. From the menu on the left, click Email Notifications.
    You can see two lists:
    • Emails of team members
    • Custom email addresses.
  4. Select one or more emails.
  5. Below the list, select the frequency of notifications.
  6. Click Save in the top left corner.

Notifications will be sent to the custom email addresses you have selected.

Webhooks

Callback URLs specified in the shared environment will be called in addition to the callback URLs specified in the inheriting test environment.

Integrations

Connected services enabled in the shared environment cannot be disabled in the inheriting test environment. You can enable additional integrations in the per-test environment.

Test Data

If you are using a CSV data file, your test data variables and data settings cannot be changed in the inheriting test environment.

Default Environment

Every test has a default environment for backwards compatibility. Some features do not support specifying an environment. In these cases, the default is used instead. The default environment can be set by going to a test and selecting Settings from the left navigation.

Functions that do not currently support specifying an environment and will fallback to the default are:

  • Bucket-wide Trigger URLs
  • Batch Trigger URLs
  • Trigger URLs with an unspecified environment (missing runscope_environment parameter)
  • 'Run All Tests' button on the test list page
  • 'Run Again' button on the test result page
  • AWS CodePipeline test runs