Phy-gital Roundtable: Breakfast Roundup from Germany and Netherlands

02 May '15 | Debjyoti Paul

German Shoppers: Meet Them in the Fast Lane to Phy-gital

15 January '15 | Ralf Reich

Shoppers Will Share Personal Information (But They Don’t Want to be “Friends”)

15 January '15 | Anil Venkat

Modernize or Perish: Property and Casualty Insurers and IT Solutions

14 January '15 | Manesh Rajendran

Benelux Reaches the Phy-gital Tipping Point: Omnichannel Readiness is Crucial

13 January '15 | Anil Gandharve

The New Omnichannel Dynamic: Finding Core Principles Across Industries

13 January '15 | Debjyoti Paul

Technology does not disrupt business – CIO day 2014 Roundup

02 December '14 | Anshuman Singh

Apple Pay – The Best Is Yet To Come

02 December '14 | Indy Sawhney

Digital transformation is a business transformation enabled by technology

01 December '14 | Amit Varma

3 Stages of FATCA Testing and Quality Assurance

06 October '14 | Raman Suprajarama

3 Reasons why Apple Pay could dominate the payments space

18 September '14 | Gaurav Johri

Beacon of Hope: Serving Growth and Customer Satisfaction

05 August '14 | Debjyoti Paul

The Dos and Don’ts of Emerging Technologies Like iBeacon

30 July '14 | Debjyoti Paul

What You Sold Us On – eCommerce Award Finalist Selections

17 July '14 | Anshuman Singh

3 Steps to Getting Started with Microsoft Azure Cloud Services

04 June '14 | Koushik Ramani

8 Steps to Building a Successful Self Service Portal

03 June '14 | Giridhar LV

Innovation outsourced – a myth or a mirage or a truth staring at us?

13 January '14 | Ramesh Hosahalli

What does a mobile user want?

03 January '14 | Gopikrishna Aravindan

Solutions To Your Performance Testing Challenges – Part 1

Posted on: 07 January '10

In this post, I will talk about potential solutions to some of the challenges that I described earlier. The solutions to these challenges encompass technology, process as well as business aspects. While the “softer” nuances are often overlooked, they are typically the key to tackle the challenges effectively.

I have divided this blog into 2 parts so that we get to address the solutions in detail.

Methodical approach to Performance Testing (PT)

Challenge: Carrying out a complete Performance testing exercise is a comprehensive process and can be quite complex.

As mentioned in the previous blog, performance testing deals with continually changing technologies, large variety of user operating environments, collection and analysis of large volumes of data to name a few. Also there is architectural complexity associated with N-tier applications, which are made up of a large number of components residing on multiple machines. This increases the scope and complexity of testing.

Solution:

Methodical approach ensures thorough testing of the Application under test (AUT). This approach should consist of a step-by-step guide directing the performance tester during the complete PT life-cycle. A typical PT lifecycle consists of the following major phases:

   Performance test requirement/system study:
     – Application architecture and environment
     – Business process/scenario
     – Work load characteristics

   Performance strategy and planning:
     – Detailed performance test strategy and planning document
     – Workload modeling
     – Define – Transactions, think time profile, run time setting, naming convention and scripting guidelines
     – Define test data requirements

   Test development and scripting:
     – Test environment setup – load test tool, application
     – Generate load test script and load scenario based on workload model
     – Test data preparation
     – Determine what metrics to measure and track

   Performance test execution:
     – Executing load/stress/endurance tests
     – Measure response time, transaction throughput of individual transactions, understand how many interactive users the system can support on the given system, measure the utilization of system resources for every load test scenario, to verify whether the performance targets are met and establish the baseline metrics.

   Performance test result analysis:
     – Result analysis
     – Detailed reporting and recommendations

In the next part I will address the challenges related to managing PT skills, tools, and frameworks.