Phy-gital Roundtable: Breakfast Roundup from Germany and Netherlands

02 May '15 | Debjyoti Paul

German Shoppers: Meet Them in the Fast Lane to Phy-gital

15 January '15 | Ralf Reich

Shoppers Will Share Personal Information (But They Don’t Want to be “Friends”)

15 January '15 | Anil Venkat

Modernize or Perish: Property and Casualty Insurers and IT Solutions

14 January '15 | Manesh Rajendran

Benelux Reaches the Phy-gital Tipping Point: Omnichannel Readiness is Crucial

13 January '15 | Anil Gandharve

The New Omnichannel Dynamic: Finding Core Principles Across Industries

13 January '15 | Debjyoti Paul

Technology does not disrupt business – CIO day 2014 Roundup

02 December '14 | Anshuman Singh

Apple Pay – The Best Is Yet To Come

02 December '14 | Indy Sawhney

Digital transformation is a business transformation enabled by technology

01 December '14 | Amit Varma

3 Stages of FATCA Testing and Quality Assurance

06 October '14 | Raman Suprajarama

3 Reasons why Apple Pay could dominate the payments space

18 September '14 | Gaurav Johri

Beacon of Hope: Serving Growth and Customer Satisfaction

05 August '14 | Debjyoti Paul

The Dos and Don’ts of Emerging Technologies Like iBeacon

30 July '14 | Debjyoti Paul

What You Sold Us On – eCommerce Award Finalist Selections

17 July '14 | Anshuman Singh

3 Steps to Getting Started with Microsoft Azure Cloud Services

04 June '14 | Koushik Ramani

8 Steps to Building a Successful Self Service Portal

03 June '14 | Giridhar LV

Innovation outsourced – a myth or a mirage or a truth staring at us?

13 January '14 | Ramesh Hosahalli

What does a mobile user want?

03 January '14 | Gopikrishna Aravindan

Debunking the Myths in Performance Testing (PT)

Posted on: 07 October '09

In my next couple of blogs I will talk about Key myths and challenges of performance testing before I discuss other deeper topics. This blog will specifically focus on debunking the myths in performance testing.

MYTH: Performance problems can usually be fixed by simply plugging in extra hardware.

FACT: Performance issues are not always hardware-related. Performance degradation can happen for a variety of reasons, such as improper configuration of servers, badly written application code, and an un-scalable product design and architecture. E.g. If the maximum pool size of the database is set to 10, then the maximum number of simultaneous connections to the database is limited to 10, no matter how powerful the server may be.

MYTH: PT is all about learning and using a load testing tool.

FACT: Load testing tool, though important, is only one of the components of the PT life cycle. Other critical aspects include:

   * Defining clear objectives of the PT exercise.
   * Selection of scenarios which are critical for business.
   * Creating correct test data.
   * Setting up the right test environment that is representative of your production topology.

The effort to execute a PT engagement is no different than any other testing engagement. PT is complex and it needs specialized skill sets and “performance aware” engineers.

MYTH: PT is just a subset of functional testing.

FACT: PT requires a different mindset as the main objective is not to attain maximum application coverage and file bugs, but to test for response time, stability, and scalability. The desired skill-set of a PT Engineer is also unique and specialized. It is very important to educate all stakeholders of a PT engagement on the objectives and not consider it a part of functional testing. This education will avoid wrong expectations from the PT exercise and the PT team.

MYTH: PT can ONLY be done towards the end of the testing life cycle.

FACT: PT should be conducted after the application is functionally stable. It should not be done towards the end of the release since performance bugs can be quite costly to fix. Rather it should be done incrementally with a baselining effort upfront and then incremental tests that are compared with the baseline to see if performance is improving or deteriorating.

I have tried to cover some key myths here. Please do share the myths you have seen in your experience.

In my next blog, I will move on to the challenges associated with PT. In this post, I will also cover challenges associated with PT of n-tier web applications and SaaS based applications.