BlazeMeter (formerly Runscope) provides cloud-based and hybrid on-premises solutions that allow businesses to monitor, test, and debug web service APIs. BlazeMeter API tests can be used to test against services available in the public cloud, running on a private network behind a firewall, or running on a local development environment.
This workflow lets you send actionable alerts to on-call resources when xMatters gets a signal from BlazeMeter. Responders can initiate an incident with the press of a button, or you can build on the flow to perform automated resolution tasks.
How it works
When a test meets a specified threshold in BlazeMeter, it sends a JSON-formatted webhook to xMatters. A BlazeMeter API Monitoring trigger in xMatters parses the webhook and initiates a flow. The webook includes essential alert data that is included in notifications sent to users, and details about the origin of the alert that you can use to enrich the notifications or use when building automated tasks.
The following instructions describe how to install the workflow through the xMatters one-click installation process. If you're looking for instructions on the previous Runscope integration, you can find them here.
- Go to the Workflows Templates page and click the BlazeMeter tile.
- On the Install Workflow dialog box, give the workflow a name (this must be unique in your instance) and add an optional description.
- You can edit these later, if needed.
- Click Install.
- After the workflow installs, the screen shows next steps as well the installation logs. The installation logs give you additional information about the installation, such as if you have languages in your instance that aren't configured for the messages in the workflow.
- Select the authentication method you want to use.
- Copy the trigger URL — you’ll use this to configure a webhook in BlazeMeter.
- The trigger URL includes the recipients parameter, which specifies who should be notified. By default, this parameter is set to notify you (the logged in user), but you can set it to target any user or group you want.
- Click Close (or Open Workflow to view the workflow in xMatters).
Configure BlazeMeter to send requests to the trigger URL
To have BlazeMeter send alerts to the flow trigger, you need to configure a webhook and set it to use the trigger URL.
- In BlazeMeter, navigate to API Monitoring, then Connected Services:
- Go to Customized Webhook Notifications and click Connect.
- Add a Description.
- In the URL field, add the xMatters trigger URL.
- If you're using basic authentication, click Add Basic Authentication and add your authentication information.
- Add the target names of any recipients you want xMatters to notify when the monitor creates an alert.
- For example, if you want to notify Emma Pearson, Mary McBride, and the on-call members in the Monitor Team responsible for the service, you'd add ?recipients=epearson,mmcbride,monitor%20team to the URL. You must URL-encode any special characters or spaces in the target names.
- Click Save Changes.
- Navigate to the new webhook and click Test Settings.
- Select Integrations.
You're ready to use the webhook to trigger automated flows, including steps such as sending alerts and initiating incidents, though we always recommend testing before putting things into use.
The trigger expects the recipients in the trigger URL. When you copy the URL from xMatters, it includes the recipients parameter: recipients=<yourname>. Of course, you don’t want to receive all the alerts.
To change the recipients for alerts from this webhook, swap out your name for the people or groups you want to target. For example, to target the 'DatabaseTeam', 'Antares Service Team', and 'HR & Marketing' groups, add ?recipients=databaseteam,antares%20service%20team,HR%20%26%20Marketing to the trigger URL. Remember to URL-encode any special characters, including spaces, in your group names.
When a condition you've set fires, it sends a signal to xMatters, which creates an event and notifies the individual or the on-call members of the people or groups you set as recipients in the webhook URL. When the trigger receives a signal saying the issue is resolved, it automatically terminates related events in xMatters.
The person responding to the notification has the following response options:
- Acknowledge: Acknowledges the notifications and stops escalations.
- Escalate: Immediately escalates the event to the next on-call resolver in a targeted group.
- Close: Ends the xMatters event and stops notifying all targeted recipients.
- Initiate Incident: Initiates an incident in xMatters.
Now that you've installed the workflow, you can use it as-is, or customize it to suit your needs better. Here are some examples of things you can add to the workflow to customize it:
- Use Slack, Zoom, and Microsoft Teams steps to add collaboration channels to the flow.
- Change the severity of incidents created when a recipient selects the Initiate Incident response.
- Update the message sent to resolvers to include the information most relevant to your team.
- Use the BlazeMeter API Monitoring trigger to build your own custom flows.
Instructions for the previous built-in version of this integration are available below.
- Configure xMatters
- Configure Runscope
- Test the integration
- Download resources
This article provides installation, configuration, and implementation details when integrating xMatters with Runscope.
Runscope provides cloud-based and hybrid on-premises solutions that allow businesses to monitor, test, and debug web service APIs. Runscope API tests can be used to test against services available in the public cloud, running on a private network behind a firewall, or running on a local development environment.
Coupled with the power of xMatters alerts, the integration:
- Quickly identifies and notifies the on-call resource on a variety of devices.
- Allows for voice, SMS, and push messages to users.
- Allows users to reply with "Rerun" from their device to run the test again.
Event injection is initiated when a Runscope runs a test. Runscope builds a payload and sends it to xMatters.
When the test passes, nothing else happens. When the test fails, the integration notifies a recipient (an individual or a group) defined in xMatters. Recipients can respond with "Acknowledge", which causes xMatters to stop notifying other users but keeps the event alive, or "Rerun", which causes the integration to trigger another test run in Runscope, ending the current event in xMatters.
If a Runscope test fails while there is a related active event in xMatters, a new event is not created. If a Runscope test has run and passed, the integration terminates all active events related to the test.
To begin, download the workflow; it contains everything you need for this integration. Don't unzip it – you'll import the zip file into xMatters.
The first step in setting up your integration is to configure xMatters.
This integration requires a user who can authenticate REST web service calls when working with events – these permissions are provided by the "REST Web Service User" role in xMatters. See Create an integration user for more information.
Make sure you keep the user ID and password of this user handy. You'll need them when configuring other parts of this integration.
The next step is to import the Runscope workflow.
- In the target xMatters system, go to the Workflows tab and click Import.
- Browse to the .zip file you downloaded, or drag it onto the Import Workflow dialog box.
- Click Import Workflow.
- Click the gear icon beside the workflow, and select Editor Permissions.
- Add the integration user, and then click Save.
- Click the workflow name to open the Forms tab.
- For the Test Result form, click Web Service and select Sender Permissions.
- Enter the integration user, and then click Save Changes.
- Click Edit beside the form and select Layout.
- In the Recipients area, specify a recipient (a user or a group) for events, and then click Save Changes.
After you have imported the workflow, you need to set the authentication for the Runscope endpoint.
- Click the Integration Builder tab, and then click the Endpoints button to display the endpoints for the integration.
- Enter a valid username and password for Runscope.
- Select the Pre-emptive checkbox and then click Save Changes.
You need to retrieve the URLs of the inbound integrations to configure Runscope.
- Go to the Integration Builder tab and expand the list of inbound integrations.
- Click the name of the Test Results integration to view its details.
- Scroll down to How to trigger the integration at the bottom of the page, set the authentication method to URL Authentication, and then select the integration user as the authenticating user. The URL trigger is updated to reflect the new user.
- To be able to select the integration user, you need to be a supervisor of that user and the user needs to be assigned to the REST Web Services role.
- Click Copy beside the Trigger field – you'll need this to configure Runscope:
Now that you've configured xMatters, you can configure Runscope to integrate with xMatters. The following sections require you to log into Runscope and access the Tests settings page.
Runscope uses webhooks to initiate the web service calls when Runscope tests run.
Purpose: Injects an event into xMatters when a test fails.
- To configure a Test Results webhook, click the Tests tab.
- Hover over the test and click the Edit button that appears.
- In the Editor, expand Test Settings, and then click Webhooks.
- Paste the URL from the "Test Results" inbound integration into the URL field, and then click Save:
After you set up the webhook, the best way to check that the integration is working is to configure the Runscope test so it will fail. Before you do, make sure you have access to the device configured for a targeted recipient then run the test.
You should receive a notification from xMatters that the test failed. You can select Acknowledge, which keeps the xMatters event active but stops notifying other recipients, or Rerun, which terminates the event and reruns the test in Runscope. If you select Rerun, you should see a new run of the test in Runscope. If that test also fails, another event is initiated.
There are several places you can inspect when troubleshooting why an event doesn't seem to make it over to xMatters.
The first place to look is the Integration Builder Activity Stream. While on the Integration Builder tab, expand the Inbound integrations section, click the gear icon beside the inbound integration, and then click Activity Stream.
The Activity Stream contains the incoming (and for outbound integrations, the outgoing) request, any logging statements as well as the final event creation messages.
For the two-way integration from xMatters to Runscope, the primary source of logging is the Integration Builder Activity Stream for that particular integration.
For example, if you are troubleshooting why a test was not run again after a user replied with "Rerun", check the Activity Steam for the Test Result Callbacks outbound integration.