Software Metrics: A Guide to Planning, Analysis, and Application

by Pandian; C. Ravindranath

• ISBN13: 9780849316616
• ISBN10: 0849316618
• Edition: 1st
• Format: Nonspecific Binding
• Copyright: 2003-09-26
• Publisher: Auerbach Public

Summary

The modern field of software metrics emerged from the computer modeling and "statistical thinking" services of the 1980s. As the field evolved, metrics programs were integrated with project management, and metrics grew to be a major tool in the managerial decision-making process of software companies. Now practitioners in the software industry have a reference that validates software metrics as a crucial tool for efficient and successful project management and execution.Software Metrics: A Guide to Planning, Analysis, and Application simplifies software measurement and explains its value as a pragmatic tool for management. Ideas and techniques presented in this book are derived from best practices. The ideas are field-proven, down to earth, and straightforward, making this volume an invaluable resource for those striving for process improvement.This overview helps readers enrich their knowledge of measurements and analysis, best practices, and how ordinary analysis techniques can be applied to achieve extraordinary results. Easy-to-understand tools and methods are applied to demonstrate how metrics create models that are indispensable to decision-making in the software industry.

Table of Contents

1 Software Measurement	1	(12)
A New Order	1	(1)
Measurement in Quality Thinking	2	(1)
Precision in Expression	2	(1)
Representation of Reality	3	(1)
Knowledge Creation	3	(1)
Measurement Technology	4	(1)
Measuring with the Mind: Cognitive Phase	5	(1)
Measuring with Words: Semantic Phase	5	(1)
Measuring with Numbers: Quantitative Phase	6	(1)
The Three Phases Coexist	6	(1)
Measurement Scales	6	(2)
Nominal Scale	7	(1)
Typological Scale	7	(1)
Ordinal Scale	7	(1)
Numerical Scales	8	(2)
Interval Scale	8	(1)
Ratio Scale	8	(1)
Absolute Scale	8	(1)
Levels of Measurements	8	(2)
Intrinsic Nature of Measurement	10	(1)
Error, Accuracy, Precision, and Uncertainty	10	(1)
Noise	10	(1)
Sensitivity	10	(1)
Calibration	10	(1)
Scale Shape	10	(1)
Software Measuring Instruments	11	(1)
Measurement Continuum	11	(1)
The Corner Stone	12	(1)
2 Software Metrics	13	(14)
Metrics Mapping	13	(3)
Metrics List for Project Management	13	(2)
Metrics Choices: Build or Borrow	15	(1)
Simple Metrics	16	(1)
Plain Adaptation	16	(1)
Comparison	16	(1)
Ratio	16	(1)
Complex Metrics	17	(2)
Metric from Six Measurements	17	(1)
Metric from Structural Judgment	18	(1)
Metrics Are Organization Specific	19	(1)
Importance of Estimation and Planning in the Context of Metrics	19	(1)
Metrics Vocabulary	20	(1)
Guidelines from Quality Standards	21	(2)
ISO 9000 on Metrics	21	(1)
Capability Maturity Model (CMM) on Metrics	22	(1)
CMMi on Metrics	22	(1)
Applying Software Metrics: A Management Perspective	23	(2)
Benefits of Metrics	25	(2)
3 Designing a Metrics System	27	(12)
Metrics System	27	(1)
Information-Based Metrics Architecture	27	(1)
Goals: The Drivers	28	(2)
Decision Centers: The New Organization	30	(1)
Models: Knowledge Capsules	31	(2)
Metrics: Indicators-Signals	33	(1)
Measurement: Sensor System	34	(1)
Data Collection	34	(1)
Implementing the Metrics System Architecture	34	(2)
Preparation	34	(1)
Start with Small Scope	35	(1)
Begin with Lower Number of Metrics	35	(1)
Phased Expansion	35	(1)
Goal-Metric Correlation (GMC): Metrics Choice-Checking Tool	36	(1)
Metrics Planning Approaches	36	(1)
Long-Term Plan: Core Metrics	36	(1)
Short-Term Plans	37	(1)
Metrics Planning Document Checklist	37	(2)
4. Metrics Data Visualization	39	(18)
Data Analysis	39	(1)
Visual Analysis	39	(1)
Rigorous Analysis	39	(1)
Graphical Analysis	40	(1)
Visualizing Data	40	(1)
Graphical Techniques	40	(1)
Pie Charts: Distribution Analysis	41	(2)
Mapping	43	(1)
Life Cycle Profiles	44	(1)
Effort Profile	44	(3)
Process Compliance Profile	47	(1)
Responsibility Matrix	47	(3)
Resource Balancing	50	(1)
Contours	51	(1)
Radar Charts: A Balanced View	51	(1)
Dynamic Views	52	(1)
Clustering	52	(2)
Data Exploration and Visualization Tools	54	(1)
Data Visualization: Emerging Technology	55	(2)
5 Metrics Data Analysis in Frequency Domain	57	(26)
Frequency Distribution: An Analysis Tool	57	(1)
Normal Distribution	57	(1)
Bias: A Process Reality	58	(5)
Central Tendency of Processes	59	(1)
Process Spread	60	(1)
Measures of Dispersion	60	(2)
Descriptive Statistics	62	(1)
Deriving Frequency Distribution from Data	63	(4)
Basic Analysis	63	(1)
Probability Density Function Curve	63	(1)
Histogram	64	(1)
Empirical Distribution Curve	64	(1)
Frequency Scan	64	(1)
The Filter Effect: Getting a Smooth Overall Picture	65	(2)
Looking at Histograms	67	(1)
Process Capability from Frequency Distribution	67	(2)
Process Capability	67	(1)
Process Capability Index Cp	68	(1)
Calculating Cp for Software Projects	69	(1)
Probability	69	(5)
Probabilistic Expressions of Capability and Risk	71	(1)
Analyzing Process Maturity	72	(2)
Process Diagnosis	74	(9)
Beyond Mean	74	(1)
Search for Natural Process Boundary	74	(1)
Class Recognition: Productivity	75	(1)
Benchmarking	76	(2)
Measuring the True Value	78	(1)
Measuring Defects without Ambiguity	78	(1)
Comparison when Distinctions Blur	78	(3)
Six Sigma Model	81	(2)
6 Metrics Data Analysis in Time Domain	83	(28)
Viewing in Time	83	(1)
Temporal Patterns in Metrics	83	(4)
Time Series Forecasting	83	(3)
Signature Prediction	86	(1)
Prediction Windows	86	(1)
Process Characterization	87	(1)
Process Central Tendency Chart	87	(1)
Process Variation Charts	88	(1)
Plotting Central Value and Variation Together	88	(1)
Control Charts	88	(17)
Range in Expected Values	90	(1)
Life Cycle Phase Control Charts	91	(2)
When Limits Blur	93	(1)
Selecting Control Limits for Unknown Distributions	93	(1)
Control Limits for X m R Chart	93	(3)
Process Capability Baseline Charts	96	(1)
Process Capability Baselines from Empirical Distribution	96	(1)
Statistical Process Control Chart	96	(4)
Tests for Control Charts	100	(1)
Control Chart in the Presence of Trend	100	(1)
Dual Process Control Charts	100	(3)
From Dual Limits to Single Limits	103	(2)
Control Charts Types	105	(1)
Individuals Chart (X m R) with UCL and LCL	105	(1)
Special Forms	105	(4)
Performance Comparison Chart	105	(1)
Multi-Process Tracking Model	106	(1)
Dynamic Model: Automated Control Charts	106	(3)
Control Chart for Effective Application	109	(1)
Modernism in Process Control: Decision Support Charts	109	(2)
What-If Analysis	110	(1)
Clues, Not Convincing Proof	110	(1)
If It Is Written on the Wall, Do Not Draw Control Charts	110	(1)
7 Metrics Data Analysis in the Relationship Domain	111	(42)
A Fertile Domain	111	(1)
Search for Relationships	112	(1)
Perceiving Relationships	113	(1)
Strength of Relationship: Correlation Coefficient	114	(3)
Causal Relationship and Statistical Correlation	117	(1)
Linear Regression	117	(1)
Error Sum of Squares	117	(1)
The Principle of Least Squares	118	(1)
Standard Error of Estimate	118	(1)
Total Sum of Squares (TSS)	118	(1)
Coefficient of Determination R2	118	(1)
Linear Regression: Example	118	(3)
Outliers in Relationship	120	(1)
Nonlinear Regression Models	121	(1)
Nonlinear Regression Analysis of Productivity	122	(3)
Nonlinear Regression Analysis	122	(1)
Goodness of Fit	123	(1)
Monotonicity	124	(1)
Stability of Nonlinear Regression Curves: A Comparison	124	(1)
Multiple Linear Regression	125	(1)
Linearity	125	(1)
Interaction	125	(1)
Surface Plot	125	(1)
Regression Model Application	126	(1)
Application 1: Process Optimization	126	(2)
Application 2: Forecasting Product Quality	128	(1)
Application 3: Defect Correlation	128	(2)
Application 4: Causal Analysis	130	(1)
Application 5: Demonstrating How Review Makes Customers Happy (Indirectly)	130	(3)
Application 6: A Myth Breaks	133	(1)
Application 7: The Crossover	133	(4)
Application 8: Optimum Team Size?	137	(1)
Application 9: Detecting Hidden Problems	137	(3)
Application 10: Analysis of Defect Discovery Economics	140	(3)
Reliability Hinterland	140	(2)
Goodness of Fit	142	(1)
Theoretical Limits	142	(1)
Refining the Model	143	(1)
Refined Model	143	(1)
Standard Error vs. Theoretical Boundaries	143	(1)
Application 11: Building an Effort Estimation Model	143	(4)
Expectation	144	(1)
Analysis	145	(1)
Clustering	145	(1)
New Regression Models	146	(1)
Important Lesson	147	(1)
Application 12: Calibration of Intuitive Models	147	(3)
Calibration: Ascertaining Prediction Errors	147	(1)
Regression Analysis	148	(1)
Fantasy Factor	148	(1)
Estimation Quality	148	(1)
Evaluating the Estimation Model	149	(4)
Partitioning	149	(1)
Performance of Calibrated Estimation Model	150	(1)
More Applications	150	(3)
8 Process Models	153	(20)
From Analysis to Systems Thinking	153	(1)
Model Building: Knowledge Consolidation	153	(2)
Theoretical Models: The Soul	154	(1)
Basic Empirical Models	155	(1)
Models Using Single Metric (Analytical Models)	155	(1)
Models Using Two Metrics (Regression Models)	155	(1)
Visual Models	155	(1)
Decision Support	155	(1)
Higher-Level Empirical Models	155	(2)
Descriptive Statistics on Multiple Metrics	157	(2)
Descriptive Statistics	157	(1)
Building a Multiple Metrics Model	157	(2)
Multiple Analysis of Single Metrics	159	(2)
Seeing the Meaning	160	(1)
Creating Additional Metrics from the Same Data	161	(1)
Three Analytical Dimensions	161	(3)
Process Diagnostic Panel	164	(2)
Where Mathematical Solutions Are Messy	164	(1)
Developing an Objective Function Integrating Exclusive Elements	165	(1)
Heuristic Run	165	(1)
Exploratory Data Analysis (EDA)	166	(1)
Analytical Summary of Single Metric	166	(1)
Global Summary	167	(2)
Process Correlations	169	(1)
Multiple Scatter Plots	169	(2)
DOE	171	(2)
Building Models from Experimental Data	171	(1)
Design of Experiments	171	(1)
Approach to Experiments	172	(1)
Models from DOE	172	(1)
9 Estimation Models	173	(22)
Estimation Process	173	(1)
Software Estimation Risks	174	(1)
Estimation Methodologies	175	(1)
Analogy Method	175	(1)
Bottom-Up Method	175	(1)
Top-Down Method	175	(1)
Expert Judgment Method	176	(1)
Two Variables Algorithmic Method (Parametric Method)	176	(1)
Multiple Variables Algorithmic Method	176	(1)
Thumb Rules	176	(1)
Delphi Estimate	176	(1)
Golden Rule	177	(1)
Prediction Capability	177	(1)
Prediction Equations	178	(1)
Estimation Algorithms	179	(1)
Estimation Science: The Early Models	180	(2)
Bailey-Basili Model	180	(1)
Doty Model	180	(1)
Albrecht and Gaffney Model	180	(1)
Kemerer Model	180	(1)
Matson, Barnett, and Mellichamp Model	180	(1)
Watson and Felix Model	180	(1)
Halstead Model	180	(2)
Putnam's Model	182	(1)
Barry Boehm's COCOMO (Constructive Cost Model)	182	(1)
Advent of Parametric Models	182	(1)
Calibration	183	(1)
COCOMO	183	(2)
COCOMO 11.2000 Parameters	184	(1)
Levels	184	(1)
Lookup Table	185	(1)
Equations	185	(2)
Effort Equation	185	(1)
Schedule Equation	186	(1)
COCOMO 11.2000 Applications	187	(4)
Financial Decisions	187	(1)
Trade-Off Decisions	187	(1)
Risk Management Decisions	188	(1)
Sensitivity Analysis Decisions	189	(1)
Strategic Decision Making with COCOMO	189	(1)
Optimization of Support Processes	190	(1)
Tailoring COCOMO	191	(1)
Estimation System	191	(1)
SLIM (Software Life Cycle Management)	192	(1)
SLIM-Estimate	192	(1)
Software Sizing Tools	193	(1)
Estimation Tools	193	(2)
10 Metrics for Defect Management	195	(18)
Defect Measurement	195	(1)
Metamorphosis of Defects	195	(1)
Seeing Defects	195	(1)
Counting Defects	196	(1)
Process Defects	196	(1)
Defect Classification	196	(1)
Attributes	196	(1)
Types	196	(1)
Defect Database	197	(1)
Analysis of Defect Data	198	(2)
Summary Information	198	(1)
The 80/20 Analysis	198	(1)
Example of Defect Pareto Chart	199	(1)
Defect Management Graphs	200	(1)
Defect Correlation	200	(1)
Defect Driver Matrix	201	(1)
Looking for Consistency	202	(1)
Defect Control Chart	202	(1)
The 1:10:100 Rule	202	(1)
Defect Filter Matrix	202	(5)
Analysis 1: Defect Removal Effectiveness (DRE)	204	(1)
Analysis 2: Dynamic Model for DRE	204	(2)
Analysis 3: Defect Profile	206	(1)
Analysis 4: Influence of DRE on Cost	206	(1)
Analysis 5: Forecasting Hidden Defects	206	(1)
Analysis 6: RGC	207	(1)
Defect Detection Probability	207	(1)
Rayleigh Defect Discovery Model	208	(1)
Three Phases of Reliability Measurement	209	(1)
Reliability Enhancement	209	(1)
Home-Grown Model	210	(1)
Broad-Based Approach	210	(1)
Use Defect Models, Stay Proactive	210	(1)
Quantitative Defect Management	210	(3)
Managing Process Defects	211	(1)
Creating Product Health Report	211	(2)
11 Online Use of Metrics	213	(12)
The Challenge	213	(1)
Metrics Intelligence	213	(1)
Metrics Synchronization	214	(1)
Milestone Diary	214	(1)
Earned Value Model	215	(4)
Key EVM Parameters	215	(1)
Earned Value Model Table	216	(1)
Earned Value Graph	216	(3)
Baseline Plot	216	(1)
Tracking	216	(3)
Complete Earned Value Graph	219	(1)
Extended Milestone Diary	219	(1)
Responding to Metrics	220	(2)
The Decision Point	220	(1)
High-Speed Decision Making	221	(1)
Responsive Action	221	(1)
Cultural Induction of Metrics	222	(1)
Discovering "the Factory within the Factory"	222	(1)
Phasewise Reestimation	222	(1)
Managing New Technology	223	(1)
Few Data: Sharp Focus	223	(1)
Data Connections	223	(1)
Early Warning	223	(1)
Choice of Online Metrics	224	(1)
Representative Metric	224	(1)
The Magical Seven	224	(1)
Critical Metrics	224	(1)
Benefits of Online Metrics	224	(1)
12 Metrics-Based Decision Support Systems	225	(16)
Two Systems	225	(1)
The Humble Beginning	225	(1)
Advent of Software Management Tools	226	(2)
Software Management Tools that Focus on Engineering	227	(1)
Software Management Tools that Focus on Estimation	228	(1)
Software Management Tools that Focus on Testing	228	(1)
Dashboard	228	(1)
Software Management Tool Vendors	228	(1)
Birth of Process Databases	228	(2)
Enterprise Integration	230	(3)
Intelligence Integration	230	(1)
Enterprise Resource Planning (ERP) and Metrics	230	(1)
Enterprise Metrics	231	(1)
ERP Vendors	232	(1)
Process Intelligence	233	(2)
Metrics Warehouse	233	(1)
Metrics Data Mining	234	(1)
Applying Business Intelligence Tools to Metrics	234	(1)
Enterprise Intelligence Systems and Metrics	235	(1)
A Symbiotic Dependence	235	(1)
An Economic Alternative: Metrics-Based Decision Support Systems (DSS)	236	(2)
Metrics-Based DSS	236	(1)
Human-Centric Approach	237	(1)
Manual Analysis	237	(1)
Simple Tools	237	(1)
Web Enabling	238	(1)
Knowledge Management	238	(1)
Human Inquiry	239	(1)
Metrics Dashboard	239	(1)
MBDSS: Information, Intelligence, and Strategy	239	(2)
13 Metrics for Strategic Vision	241	(16)
Beyond the Obvious	241	(1)
Model-Based Approach	241	(1)
The Vision Called Integration	241	(1)
Metrics in Project Management	242	(1)
Tailoring Metrics for the Project	242	(1)
Setting Quantitative Goals: Goal-Metrics Correlation (GMC)	242	(2)
GMC Analysis	244	(2)
Metrics Effectiveness	244	(1)
Goal Deployment	245	(1)
Iterative Process	245	(1)
Quality Function Deployment (QFD)	246	(2)
Stage 1: Defining Customer Requirements	246	(1)
Stage 2: What-How Analysis	246	(1)
Stage 3: Process Analysis	247	(1)
Stage 4: Benchmarking	248	(1)
Risk Estimation	248	(1)
Simulating Schedule Risk	249	(1)
Mapping Risk Using Risk Exposure Number	250	(1)
Analysis of REN	250	(4)
Six Sigma Renaissance	254	(1)
Six Sigma Vision	254	(1)
Metrics in the Boardroom	254	(1)
Money, the Greatest Metric	254	(1)
Metrics Black Belts	255	(1)
Measurement Capability	255	(1)
Consummate Vision	255	(2)
14 Metrics System Implementation	257	(10)
Toward Truth	257	(1)
No Universal Method	257	(1)
Roadmap?	257	(1)
Effective Use of Metrics	258	(1)
Looking at Metrics Data	258	(1)
Goal Activation	258	(1)
Knowledge Discovery from Data	258	(1)
Data Visualization	259	(1)
Applying Metrics	259	(2)
Application Categories	259	(1)
Value Generation	260	(1)
Deconstruction	260	(1)
Creating Decision Centers	261	(1)
Equip People with Knowledge at Less Cost	261	(1)
The Marvelous Spreadsheet	262	(1)
Things to Remember during Implementation	263	(1)
Lead with Numbers	263	(1)
Integrated Management	264	(1)
Mirror, Microscope, and Telescope	264	(1)
Unlimited Scope	265	(2)
Bibliography	267	(6)
URLs	270	(3)
Index	273