Sunday, November 25, 2007

When to Release your Software?


A major problem for directors, managers, product managers and quality assurance personnel is to decide when the software is 'reliable enough' to be released to the market. Such decisions are primarily made subjectively or by probablistic methods rather than using quantitative means and decision theory to objectively measure and make informed release time decisions.
Last week, I was in Edmonton at the CIPS ICE Conference giving a talk on this topic and was surprised to find out how many organizations struggle with this decision.
I presented a multi-dimensional defect prioritization and release model/methodology which sets priorities on defects based on project constraints, stakeholder opinions, risk of not fixing a defect and analysis of defect types, arrival patterns and collection mechanisms.

The methodology presents various release options based on target reliability levels, acceptable level of risk, effort spent on testing and time to market. I got a lot of feedback from the audience and a lot of questions about the case studies I presented.

One of the biggest challenges of implementing this teachnique in an organization is leadership perception and their buy-in. The technique also uses Rough Set Analysis to conduct root cause analysis and the audience was very interested in pattern generation.

I had especially struggled with this area when building this methodology. All the standard techniques for defect root cause analysis such as IBM's ODC, HP Defect Classification and IEEE Classification require complete and consistent data, but the data which I had to generate patterns from was incomplete and inconsistent. Rough Set Analysis is definitely best suited for such situations and led to eye-opening results.

Currently, I am working on a paper to get this work published, but will definitely push ahead aggressively to find situations where "when to release" decisions become tricky to make.

Wednesday, November 14, 2007

Aligning Projects with Corporate Strategy Presentation


First of all, I would like to apologize to all the readers of this blog for not being able to write something for a little while as I was traveling most of the time. At my PMI presentation last month about "Aligning project with corporate strategy using Balanced Score Cards", I got a lot of very interesting questions from the audience. Some of the questions were around stakeholder consensus, balancing of priorities, changing needs of business and actual implementation of Balanced Scorecards.

These questions definitely stimulate my mind in understanding the concerns other organizations may have in implementing Balanced Score Cards.

I would also like to thank Navneet Bhushan, a great mentor of mine for sharing an interesting WIPRO white paper on "Value of IT", where he has used AHP (Analytical Hierarchy Process) to obtain relative weights on criteria defined in an organization's Balanced Score Card. I will post more on this topic soon.... Here is the link to my presentation: