Why you should execute your performance tests gradually?

Let’s assume that we have a planned performance testing run with 10,000 users.

In this article I will discuss with you why we should start our execution gradually , from my point of view you should not start the run with the mentioned number of users , 10,000 users couldn’t be the start , for the following reasons.

  1. Frustration
    Most of the times when this is the first run ever , it will fail and may be failed dramatically with very high response time and tons of errors.
  2. Observation
    When we start the run gradually let’s say we started with the 10% of the load which is 1000 users , we can observe while increasing the load the response time changes from run to another also we can observe the backend metrics (CPU , Memory) changes between the runs.
    This will absolutely give you a better understanding how the system under test behaving with the user increase.
  3. 3. Cost Benefit analysis
    Referring to the previous point , it will be clear which part of the system will be worth investing in , here I mean which is more cost saving (enhancing the software or buy/rent more hardware).

In the following I will suggest a simple execution plan , you can tweak it to match your case.

As shown on the previous table i suggest 4 steps to reach 100% of the required load , you can absolutely skip steps or decreasing the number of steps if you observe in your results that the difference in response time is minimal when raising the load.

That’s for today 🙂 , hope you find it useful.

Please share your tips, experience, comments, and questions for further enriching this topic of discussion.

Originally published at http://thetesttherapist.com on May 24, 2022.

--

--

--

Performance Test Engineer | Speaker | Blogger | HP Load Runner Certified | ISTQB Performance Testing Certified

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Mohamed Tarek

Mohamed Tarek

Performance Test Engineer | Speaker | Blogger | HP Load Runner Certified | ISTQB Performance Testing Certified

More from Medium

Why you need to test before and during your Oracle EBS to Cloud migration

Part 1 : Test Driven Development — the basics

Say Hello to OAuth!

Testing: A Sometimes Tedious but Crucial Part of Software Development