Test steps often rely on data parameters, such as menu item names, usernames, or numeric values. You can hard-code these values or parameterize your test cases with different variable values.
- How can I parameterize my test data?
- When to choose which option?
- How to add Data Entities?
- How to manage Data Entities?
- How to share or back up test data?
- How to manage CSV files?
- How to insert Data Parameters into tests?
- How to manage Data Parameters?
- Which data is used in which Tests or Mock Services?
- How to preview test data?
- How to control the number of iterations/data size?
- How to resolve data definition errors?
How can I parameterize my test data?
If you choose to parameterize your tests, you have the following options:
or any combination of these data sources.
When to choose which option?
- If your test data is a list of fixed values, or has dependencies between columns, the best solution is to collect this data in spreadsheet columns and attach the CSV file to the test.
- If you need dynamic test data, generate it synthetically. Generated test data looks like real or random data, but you have full control over its form, and you don't have to collect it yourself. You generate data using Test Data Generator Functions.
- Synthetic test data is advantageous in tests where you need dynamic parameter values, such as relative date stamps ("today" or "last month"), fake but valid credit card numbers, random but plausible names, and so on.
- BlazeMeter additionally helps you avoid invalid values: The included functions don't generate dates such as February 31, names such as asdf%as'df, nor credit card numbers with invalid checksums.
- If you use the CA Test Data Manager product and its Find & Reserve feature, BlazeMeter offers TDM integration to access your TDM F&R Models to load test data from multiple sources.
How to add Data Entities?
A Data Entity is a container for test data. You can Still add data from other sources, such as CSV files or synthetic test data, later.
GUI Functional tests currently support one Data Entity only. Performance tests support multiple Data Entities.
To add a Data Entity to a Performance test, follow these steps:
- Click Test Data to open the Test Data pane.
- Click either the big blue Plus button or click TEST DATA... > Add Data Entity.
Choose one of the following options:- Create New Data Entity. Use this option to manually add Data Parameters. Give the Data Entity a descriptive, unique name.
- Create New Data Entity From CVS File. Select a CSV file with test data from your file system.
Attach CSV Files From Test Configuration. Use this option to create a new Data Entity from an already present CSV file in the test configuration.
- Load Data Entity From Workspace. Select a shared Data Entity that is stored in your workspace.
- Import Data Entity From Exported File. Use this option to create a new data entity from a previously exported file.
- Click Add.
How to manage Data Entities?
To view all Data Entities, click TEST DATA... > Manage Data Entities. If no team members have saved any data entities to the Workspace, this window is empty.
Hover the mouse over a Data Entity to access editor buttons.
- Click Clone Data Entity to make a copy that you can edit without interfering with tests that are using the original shared Data Entity.
- Click Rename Data Entity to enter a new name for this shared Data Entity.
- Click Delete Data Entity to remove a possibly shared Data Entity from all tests. Verify whether the data is unused before deleting the Entity.
Each Data Entity has three tabs that let you drill deeper:
- The Data Parameters tab lets you edit data parameters.
- The Usage tab lets you see which tests are using this shared Data Entity.
- The Data Preview tab lets you preview test data values.
How to share or back up test data?
For each data entity, use the Ellipsis menu next to its name to manage it:
- Use the Ellipsis menu to Rename or Remove Data Entities from the test. If you don't save them, removed Data Entities are also deleted from the Workspace.
- To export any Data Entity as a spreadsheet so you could import it, for example, into MS Excel, use the Ellipsis menu and select ... > Download Data As CSV.
- To share a Data Entity with your team, use the Ellipsis menu and select ... > Save to Workspace. To use a shared Data Entity in your test, select ... > Load From Workspace.
- To make local backups, use the Ellipsis menu and select ... > Export to File. To restore a Data Entity from such an exported file, select ... > Import From File. For more information, see How to Share Test Data.
How to manage CSV files?
Expand the Data Entity and hover the mouse over a CSV file entity in the data entity to access the following buttons:
- Download CSV
- Edit CSV
- Delete CSV
How to insert Data Parameters into tests?
If you are using the GUI Functional Test debugger, click Stop to close the debugger before defining new test data.
- Open a Test and go to the Configuration tab.
- Click Test Data.
A pane with data entities opens on the right side. - Click the Plus sign and create a parameter.
To initialize the parameter, choose one of the following procedures:- Generate Synthetic Test Data
- Load Test Data from Spreadsheets
- Find Test Data from TDM F&R Models
You have now defined a parameter value.
- Click Copy Parameter Name to Clipboard.
The clipboard now contains a string such as ${address}.
- Return to the test configuration and edit the appropriate test step. For a GUI Functional test, edit a test step in the Scriptless Editor. For a performance test, edit a HTTP Request field in JMeter.
- Replace a hard-coded value with the pasted parameter.
Example: In a GUI Functional Test, paste the parameter as a value into a test action.
- Click Run Test in the left column to execute the test.
BlazeMeter now uses test data driven by your loaded Data Entities and replaces Data parameters in the test with your chosen dynamic values.
How to manage Data Parameters?
Parameter names have to be unique across all Data Entities in your test. If two parameters have the same name, one will override the other in an arbitrary order. Therefore, especially after uploading CSV files, review the loaded parameter names in the Test Data Management pane, and rename them, if needed. You can edit Data parameters for a specific test or edit shared data for everyone who uses it.
Edit Data Parameters in the current test
Open the Test Data pane, hover the mouse over a parameter definition to show the editor buttons.
The four buttons have the following functionalities, from left to right:
- Copy Parameter Name to Clipboard so you can paste it easily into the test definition.
- Preview one instance of generated data. Click again to toggle back to the function view.
- Edit this parameter definition to change the parameter name, the function, or its arguments.
- Delete this parameter. If the deleted parameter is in use in a scenario step, the step will break.
Edit Data Parameters of all Data Entities
Restriction: This pre-GA (general availability) feature is accessible only to a select set of customers. The full feature will soon be made available.
- Open the Test Data pane, click TEST DATA... > Manage Data Entities.
The list of shared Data Entities opens.
- You can sort shared Data Entities by name, by who last edited the entity, and by last updated date.
- Expand a Data Entity in the list.
Three tabs appear, Data Parameters, Usage, and Data Preview.
- Go to the Data Parameters tab and select a Data Parameter from the list.
- Details appear in the right pane.
- You can edit the following properties
- Parameter Name
Editing the name here updates it in all tests that use this Data Parameter.
- Parameter Value
Enter either a static (hard-coded) string or number, or select a data generator function.
To define a function:
- Enter a term to search a suitable function.
Example: rand, day, date, credit, SSN, CSV, JSON. Loremipsum, seedlist, regexp, etc.
- Click a function name to preview its manual page, its arguments and examples.
- Hover the mouse over a function name and click Insert Function.
The empty function is inserted with the caret between the parentheses.
Example: randInt()
- Fill in the required arguments as shown in the examples.
Example: randInt(18,99)
Tip: If you start typing into the value field, BlazeMeter starts suggesting a list of know functions to insert. The shortcut to view the list of functions for parameter values is ctrl-space. For more information about functions, see also Test Data Generator Functions.
- Enter a term to search a suitable function.
BlazeMeter auto-saves your changes when you leave a field.
Which data is used in which tests or Mock Services?
Restriction: This pre-GA (general availability) feature is accessible only to a select set of customers. The full feature will soon be made available.
- Open the Test Data pane, click TEST DATA... > Manage Data Entities.
The list of shared Data Entities opens.
- Expand a Data Entity in the list.
Three tabs appear, Data Parameters, Usage, and Data Preview.
- Go to the Usage tab.
- Select either Tests or Mock Services.
BlazeMeter lists the Tests or Mock Services (respectively) that use this Data Entity.
The list includes the following details:
- The names of the tests or Mock Services (respectively).
- Test type (for tests only)
- Either project name (for tests only) eor Service name (for Mock Services only)
- Last Run date and time
- Click the name of the test or Mock Service to open it.
How to preview test data?
Before a test run, you can preview your test data in the Test Data pane by clicking Iterations (for GUI Functional Tests) or Data Settings (for Performance Tests and Mock Services), respectively.
After a test run, go to the History tab, open the test Report, and go to the Summary tab. Under Test Data, click Show Test Data to review which data was used. Here you can also click the Rerun button to run this test again with the same test data, which can be useful for debugging.
You can also preview the data in all shared data Entities.
Restriction: This pre-GA (general availability) feature is accessible only to a select set of customers. The full feature will soon be made available.
Open the Test Data pane, click TEST DATA... > Manage Data Entities.
The list of shared Data Entities opens.
Expand a Data Entity in the list.
Three tabs appear, Data Parameters, Usage, and Data Preview.
Go to the Data Preview tab.
Preview the data.
(Optionally) Define the data size.
(Optionally) Download the data as csv file.
How to control the number of iterations/data size?
When test data is generated by functions and not hard-coded, it is available at any quantity. When you load test data from CSV files, you choose whether you want to use all rows or a subset. The number of rows of test data corresponds to the number of iterations of a GUI Functional test, so while debugging, you maybe prefer only 1 iteration.
To control how many rows of test data are used in a test, configure the test iteration settings.
How to resolve data definition errors?
No data can be generated as long as there are errors in the data definition. Errors include missing or misspelled arguments of generator functions, missing mandatory values, inappropriate data types (such as entering text where a number is expected), unpaired quotation marks or parentheses, missing files, and so on.
Errors are clearly indicated by the inline validator in the Test Data pane, so you can address each warning immediately. If you have loaded a Data Model that contains multiple errors, an error bar will indicate the number of issues to address before data can be generated. Click the number in the error bar to review a detailed list of detected issues and a description of the error. Then click each listed data parameter or data entity to quickly navigate to the item to fix it.
0 Comments