Phy-gital Roundtable: Breakfast Roundup from Germany and Netherlands

02 May '15 | Debjyoti Paul

German Shoppers: Meet Them in the Fast Lane to Phy-gital

15 January '15 | Ralf Reich

Shoppers Will Share Personal Information (But They Don’t Want to be “Friends”)

15 January '15 | Anil Venkat

Modernize or Perish: Property and Casualty Insurers and IT Solutions

14 January '15 | Manesh Rajendran

Benelux Reaches the Phy-gital Tipping Point: Omnichannel Readiness is Crucial

13 January '15 | Anil Gandharve

The New Omnichannel Dynamic: Finding Core Principles Across Industries

13 January '15 | Debjyoti Paul

Technology does not disrupt business – CIO day 2014 Roundup

02 December '14 | Anshuman Singh

Apple Pay – The Best Is Yet To Come

02 December '14 | Indy Sawhney

Digital transformation is a business transformation enabled by technology

01 December '14 | Amit Varma

3 Stages of FATCA Testing and Quality Assurance

06 October '14 | Raman Suprajarama

3 Reasons why Apple Pay could dominate the payments space

18 September '14 | Gaurav Johri

Beacon of Hope: Serving Growth and Customer Satisfaction

05 August '14 | Debjyoti Paul

The Dos and Don’ts of Emerging Technologies Like iBeacon

30 July '14 | Debjyoti Paul

What You Sold Us On – eCommerce Award Finalist Selections

17 July '14 | Anshuman Singh

3 Steps to Getting Started with Microsoft Azure Cloud Services

04 June '14 | Koushik Ramani

8 Steps to Building a Successful Self Service Portal

03 June '14 | Giridhar LV

Innovation outsourced – a myth or a mirage or a truth staring at us?

13 January '14 | Ramesh Hosahalli

What does a mobile user want?

03 January '14 | Gopikrishna Aravindan

Solutions To Your Performance Testing Challenges – Part 2

Posted on: 11 January '10

Tools and Framework

Challenge: Simulating large number of users

This is a challenge since pricing for commercial tools is on a per virtual user basis. Licensing cost associated with large number of virtual users may prove to be cost prohibitive


– Open source tools and in-house accelerators: Often times, use of expensive commercial tools can be avoided, by considering solutions involving more cost-effective ways of handling PT engagements. Over the years Mindtree has developed powerful accelerators around JMeter to overcome its inherent limitations related to scripting/debugging (Mindtree PT Scripting Helper Toolkit), large scale distributed load generation (Mindtree PT Framework) and reporting (JMeter Aggregate Reporting Framework)

Combination of open-source tools and in-house accelerators can be a good low cost solution for overcoming the challenges associated with simulating a large number of virtual users in diverse operating environments.

– Partnerships with load testing tool vendors: On few occasions you have to rely on commercial tools to devise solutions for complex problems. Partnerships with tool vendors would help you not just build competency in the tool but also devise solutions using the tools.

– Cloud based load testing: Cloud based load testing can provide elastic scaling that is critical for large scale load simulation. Over the years many tool vendors have embraced the “cloud” and have come up with OnDemand/SAAS based load generation model (e.g. HP SAAS). This is certainly a good alternative to evaluate if your performance test effort requires large volumes of load to be simulated

Skills and Expertise

Challenge: Paucity of skilled Performance testing engineers


In order to be able to execute the above phases successfully, it becomes imperative to build and nurture a specialized team for performance testing: PT is much more than the ability to create scripts using a particular tool. A dedicated team is needed that can:

– Specialize in the classic PT phases such as performance test strategy planning, scripting performance scenarios, execution, reporting and analysis that all tie into the performance objectives for the AUT

– Understand technologies and challenges and come up with relevant solutions at a faster pace

However the dedicated team created may not always possess the requisite skills for advanced performance engineering activities. In order to resolve the issues found through Performance Testing, individuals with specialized performance engineering skills such as database tuning, application code profiling are needed. Hence it becomes imperative to have ready access to a virtual pool of experts that can work in conjunction with the dedicated team, on demand. These experts may not be a part of the dedicated team, but a slice of their time can be utilized, as required.

I have tried to provide a glimpse of the solutions that we have devised to overcome the challenges associated with PT. Needless to say, these solutions are continuously evolving to keep pace with changing technologies, product performance goals and end customer requirements.

Mindtree Blog Archives

Mindtree blog Archives are a collection of blogs by various authors who have independently contributed as thought leaders in the past. We may or may not be in a position to get the authors to respond to your comments.