Phy-gital Roundtable: Breakfast Roundup from Germany and Netherlands

02 May '15 | Debjyoti Paul

German Shoppers: Meet Them in the Fast Lane to Phy-gital

15 January '15 | Ralf Reich

Shoppers Will Share Personal Information (But They Don’t Want to be “Friends”)

15 January '15 | Anil Venkat

Modernize or Perish: Property and Casualty Insurers and IT Solutions

14 January '15 | Manesh Rajendran

Benelux Reaches the Phy-gital Tipping Point: Omnichannel Readiness is Crucial

13 January '15 | Anil Gandharve

The New Omnichannel Dynamic: Finding Core Principles Across Industries

13 January '15 | Debjyoti Paul

Technology does not disrupt business – CIO day 2014 Roundup

02 December '14 | Anshuman Singh

Apple Pay – The Best Is Yet To Come

02 December '14 | Indy Sawhney

Digital transformation is a business transformation enabled by technology

01 December '14 | Amit Varma

3 Stages of FATCA Testing and Quality Assurance

06 October '14 | Raman Suprajarama

3 Reasons why Apple Pay could dominate the payments space

18 September '14 | Gaurav Johri

Beacon of Hope: Serving Growth and Customer Satisfaction

05 August '14 | Debjyoti Paul

The Dos and Don’ts of Emerging Technologies Like iBeacon

30 July '14 | Debjyoti Paul

What You Sold Us On – eCommerce Award Finalist Selections

17 July '14 | Anshuman Singh

3 Steps to Getting Started with Microsoft Azure Cloud Services

04 June '14 | Koushik Ramani

8 Steps to Building a Successful Self Service Portal

03 June '14 | Giridhar LV

Innovation outsourced – a myth or a mirage or a truth staring at us?

13 January '14 | Ramesh Hosahalli

What does a mobile user want?

03 January '14 | Gopikrishna Aravindan

What is the right metrics and measures that suits my testing project / engagement?

Posted on: 27 July '10

I know this is a sticky question for any testing professional. Metrics and measures form a very important part of managing and governing projects well. This is especially true with testing projects as the need to measure and communicate the quality is paramount. Metrics provide a platform/framework for teams to be able to analyze and understand their capabilities and find ways to improve. At the same point it is important for projects to find out what should be measured, what are the metrics that make sense for my project.

One of the things we have evangelized at Mindtree is for test teams to define clearly keeping their customer in mind, what their testing objectives/scope/goals are. To help teams come up with right metrics or measures for their projects, we have launched the TMAD model, what it stands for is the “Testing Metrics Analysis and Decision” making framework.

This simple to use framework contains few excel sheets. The first sheet contains an exhaustive definition of metrics. What is interesting is that it not only contains the definition, but also –

– Goal that the metric helps to meet
– Questions one should ask if the metric is below/above the baseline
– What kind of behavioral change could it lead to among the team members
– Relevance of this metric in the type of project you are executing

Another important message that we often hear and very true is to never look at one metric as a standalone. To make sense of a metric and get the right picture, you might need to look at few other metrics. E.g. A defect trend metric might need to be correlated with a defect ageing metric to make more sense. Hence, the second sheet of the TMAD model helps the testers to see the influence of one metric on the other metric. This would give the tester a view of what metrics are related and how they need to be viewed. The last sheet of the model talks about important attributes, such as product quality, and the metrics that we need to look at to understand it.

This model has evolved over a period of time and now we are able to identify the right metrics and apply it across various projects. In my next blog, let me take you through a real case study with some practical examples.

Meanwhile, do let me know your thoughts on how you went about identifying the right metrics and measures for a given project/engagement. Challenges you faced in the process and how you have overcome them.

  • Geetha Chandar

    Hi Sylvia,

    It was great to read about your success story in the book, Unbound: Indian Women @Work by Gita Aravamudan. I guess MindTree’s unique differentiator – ‘Baby’s Day Out’ – owes its origin to you and your daughter, Ananya! And thanks a ton for sharing ‘Think Opportunities, Not Constraints’!

    Thanks and regards,

    Geetha