A single web page presented in a browser can generate tens, sometimes hundreds of unique HTTP requests. The browser, after receiving all of the responses, renders the page for the user to view.
Every browser (IE, Firefox, Chrome,Safari, et.al.) has its own way of generating the HTTP request according to the viewed web page. In a load scenario, the overall number of HTTP requests is directly related to the number of users that are surfing concurrently. All requests hit the server during the test generating a response for each request.
Metrics
To better understand overall system performance, consider the following three metrics:
- Perceived system performance - System performance as perceived by the load testing servers. The load testing servers measure numerous metrics related to all generated requests and responses received.
- Perceived user experience - Page load time as perceived by a real browser. This metric represents the user experience. In particular the time it takes the browser to load a certain page during the test.
- System performance - The system traditional KPIs such as CPU, memory, bandwidth, etc as measured during the test.
Perceived System Performance
Perceived system performance applies three different measurements to each unique request that is part of the simulated traffic and three different measurements for the aggregated results of the simulated traffic. These measures allow a load testing professional to evaluate the performance of each request under a certain load.
Perceived system performance provides aggregated reports as well, taking into account all request and responses. The aggregated reports can provide insight while identifying bottlenecks. Some examples of conclusions that can be reached via perceived system performance:
- Performance results can state that an average response time of a website is 700 milliseconds. However, some POST requests response time can grow with the growth of the number of users. One can only identify this by looking at the specific reports of each request.
- Identify that a DB request is taking too long to execute under a load scenario.
- Discover which CSS pages break under a load.
- Connection timeouts and broken connections.
- Error responses generated under load.
Perceived User Experience
Perceived user experience provides an answer to one of the most important questions:
Q: What would be the user experience under a certain load scenario?
As each brand of browser generates the HTTP requests in a different way, the above mentioned metric (Perceived System Performance 'PSP') cannot tell us what would be the perceived user experience.
Consider the example where a page generates 10 HTTP requests. Assume each HTTP request takes 1 second to load, what would be the load time of the full page?
It's hard to say. Some browsers will execute all requests in parallel while some will execute one after the other. So it can be anywhere from 1 to 10 seconds. The only way to measure the user experience is by launching a real browser and measure the load time of the web page.
Using the same technique under a load scenario can assist in an evaluation of the user experience during the load.
With the perceived user experience, a website owner can know what the user experience would be under some load scenarios.
For example:
- A web page load time can be 2 seconds at 100 users and 4 seconds at 500 users.
- The website will not load at all at 1000 users.
System Performance
System performance completes the performance picture by describing the system performance using traditional KPIs such as:
- CPU
- Load
- Memory
- Bandwidth
Correlating perceived system performance and system performance results can assist with the identification of bottlenecks and problems that are responsible to a poor performance level.
For example: If under a certain load the CPU level of the server under test goes over 70%, we know that the server is not capable dealing with such a load. That said, the response time gathered from perceived system performance, can tell us about the same thing.
Want to learn more about load testing with BlazeMeter? You'll want to view our on-demand recording, Load Test Like a Pro
0 Comments