Software Quality Approaches

by Haug, Michael; Olsen, Eric W.; Consolini, Luisa

• ISBN13: 9783540417842
• ISBN10: 3540417842
• Format: Paperback
• Copyright: 2002-01-01
• Publisher: Springer Verlag

Summary

This book is a result of the European Experience Exchange (EUREX) project sponsored by the European Systems and Software Initiative for Software Best Practice in Europe. The EUREX project analyzed the industrial and economic impact and the similarities and differences between and among more than 300 Software Process Improvement Experiments sponsored by the EU. The current volume offers a variety of perspectives on software quality issues resulting from that analysis, including testing, verification and validation. This area represents one of the 'great unknowns' in software development in the sense that many organisations, especially small and medium enterprises, have no purposeful process addressing these issues. As a result, this book is particularly meaningful for software practitioners in such enterprises, including both developers and line managers.

Table of Contents

Part I SPI, ESSI, EUREX	1	(30)
Software Process Improvement	3	(14)
Introduction	3	(1)
Objectives - Scope of the Initiative	3	(1)
Strategy	4	(1)
Target Audience	5	(1)
Dimensions of Software Best Practice	5	(2)
European Dimension	7	(1)
Types of Projects	8	(9)
Stand Alone Assessments	8	(1)
Process Improvement Experiments (PIEs)	9	(2)
Application Experiments	11	(1)
Dissemination Actions	11	(1)
Experience/ User Networks	12	(1)
Training Actions	13	(1)
ESSI PIE Nodes (ESPINODEs)	13	(1)
Software Best Practice Networks (ESBNETs)	14	(3)
The EUREX Project	17	(8)
Target Audience and Motivation	17	(2)
Objectives and Approach	19	(1)
Partners	20	(1)
Related Dissemination and Training Actions	20	(5)
Software Improvement Case Studies Initiative (SISSI)	20	(2)
ESPITI	22	(3)
The EUREX Taxonomy	25	(6)
Analysis and Assessment of PIEs	25	(1)
Classification into Problem Domains	25	(5)
First Regional Classification	26	(1)
Result of First Regional Classification	26	(1)
Consolidation and Iteration	26	(1)
Update of Regional Classification	26	(1)
Mapping of Attributes	27	(1)
Review of Classification and Mapping into Subject Domains	27	(1)
Subject Domains Chosen	27	(2)
Unclssified PIEs	29	(1)
Testing, Verification, and Quality Management	30	(1)
Part II Testing, Verification, and Quality Management	31	(178)
Perspectives	33	(50)
Introduction to the Subject Domain	33	(3)
Software Verification & Validation Introduced	36	(10)
Verification & Validation with Respect to the Product Development Process	36	(2)
The Main Weaknesses of the Testing Process	38	(2)
An Improved Process Model	40	(3)
How to Improve: the Road to Process Improvement	43	(2)
Cost/Benefit Analysis	45	(1)
Testware	46	(11)
A Testing Definition	46	(1)
Customer Needs	46	(1)
Types of Testing	47	(1)
Debugging	48	(1)
Other Techniques	49	(1)
Tools	49	(5)
Testware	54	(1)
Benefits and Limits	55	(1)
References	56	(1)
Classic Testing Mistakes	57	(26)
Theme One: The Role of Testing	58	(4)
Theme Two: Planning the Testing Effort	62	(3)
Theme Three: Personnel Issues	65	(3)
Theme Four: The Tester at Work	68	(6)
Theme Five: Technology Run Rampant	74	(5)
Acknowledgements	79	(1)
References	80	(3)
Resources for Practitioners	83	(4)
Methods and Tools	83	(1)
Books	84	(1)
Introductory Reference Books on Software Quality	84	(1)
Classics on Testing	84	(1)
Key Books on Testing	84	(1)
Key Books on Inspections	85	(1)
Organisations	85	(1)
Important Conferences	85	(1)
Web Sites	86	(1)
Experience Reports	87	(54)
PI3 Project Summary	90	(7)
Particuipants	91	(1)
Business Motivation and Objectives	91	(1)
The Experiment	92	(1)
Impact and Experience	93	(2)
References	95	(2)
PROVE Project Summary	97	(10)
Participants	97	(1)
Business Motivation and Objectives	98	(1)
The Experiment	99	(3)
Impact and Experience	102	(5)
TRUST Project Summary	107	(12)
Participants	107	(1)
Business Motivation and Objectives	107	(2)
The Experiment	109	(7)
Impact and Experience	116	(3)
FCI-STDE Project Summary	119	(7)
Participants	119	(1)
Business Motivation and Objectives	120	(1)
The Experiment	121	(1)
Impact and Experience	122	(4)
TESTLIB Project Summary	126	(6)
Participants	126	(1)
Business Motivation and Objectives	127	(1)
The Experiment	128	(1)
Impact and Experience	129	(3)
ATECON Project Summary	132	(4)
Participants	132	(1)
Business Motivation and Objectives	133	(1)
The Experiment	133	(1)
Impact and Experience	134	(2)
GUI-Test Project Summary	136	(5)
Participants	136	(1)
Business Motivation and Objectives	137	(1)
The Experiment	137	(1)
Impact and Experience	138	(3)
Lessons from the EUREX Workshops	141	(58)
Second Italian Workshop	141	(28)
Introduction	141	(1)
The Workshop Experts	142	(1)
Testing Web-based Applications	143	(17)
Workshop Conclusions	160	(3)
Workshop Discussions	163	(6)
Third Spanish Workshop	169	(21)
Introduction	169	(1)
Expert Presentation	170	(11)
Workshop Discussion and Conclusions	181	(9)
Pilot German Workshop	190	(4)
Introduction	190	(1)
Expert Presentation	191	(2)
Workshop Discussion and Conclusions	193	(1)
Lessons Learned from the Workshops	194	(5)
People Issues	195	(1)
Business Issues	195	(2)
Technical Issues	197	(1)
Final Conclusions	198	(1)
Significant Results	199	(10)
Barriers Preventing Change of Practices	200	(2)
Ignorance of the Software Product Quality Methods	200	(1)
Uncertainty about the Return on Investment and Fear of Raising Development Costs to an Unacceptable Level	201	(1)
Still Not Enough Pressure on Software Producers to Increase Quality Standards	201	(1)
Best Practices Recommended by Experts	202	(2)
Investing in the Acquisition of New Skills	202	(1)
Formalising the Verification Process and Integrating it with the Development Process	202	(1)
Investing Carefully but Inevitably in Automation	203	(1)
Measuring Results and Return on Investment	204	(1)
Revisiting the Classic Testing Mistakes	204	(2)
Mistakes in the Role of Testing	204	(1)
Mistakes in Planning the Complete Testing Effort	205	(1)
Mistakes in Personnel Issues	205	(1)
Mistakes in the Tester-at-Work	205	(1)
Mistakes in Test Automation	206	(1)
Mistakes in Code Coverage	206	(1)
The EUREX Process	206	(3)
Part III Process Improvement Experiments	209	(86)
Table of PIEs	211	(4)
Summaries of PIE Reports	215	(80)
ACIQIM 21757	215	(1)
AERIDS 10965	216	(1)
ALCAST 10146	217	(2)
AMIGO 21222	219	(1)
ARETES 24148	220	(1)
ASTEP 23860	221	(1)
ASTERIX 23951	222	(1)
ATECON 10464	223	(1)
ATM 21823	224	(1)
ATOS 21530	225	(2)
AUTOMA 10564	227	(1)
AUTOQUAL 24143	228	(2)
AVAL 21362	230	(2)
AVE 21682	232	(1)
BEPTAM 21284	233	(1)
CALM 21826	234	(1)
CITRATE 23671	235	(1)
CLEANAP 21465	236	(2)
CLISERT 24206	238	(1)
CONFITEST 24362	239	(1)
DATM-RV 21265	240	(2)
DOCTES 21306	242	(1)
EMINTP 21302	243	(2)
ENG-MEAS 21162	245	(1)
EXOTEST 24266	246	(1)
FCI-STDE 24157	247	(1)
FI-TOOLS 21367	248	(1)
GRIPS 23887	249	(1)
GUI-TEST 24306	250	(1)
IDEA 23833	251	(1)
IMPACTS2 24078	252	(1)
INCOME 21733	253	(1)
MAGICIAN 23690	254	(2)
METEOR 21224	256	(1)
MIST 10228	256	(1)
ODP 10788	257	(1)
OMP/CAST 24053	258	(1)
PCFM 23743	259	(1)
PET 10438	260	(2)
PI3 21199	262	(1)
PIE-TEST 24344	263	(1)
PREVE-DEV 23705	264	(1)
PROVE 21417	265	(1)
QUALITAS 23834	266	(2)
RESTATE 23978	268	(1)
SDI-WAN 10494	269	(1)
SIMTEST 10824	270	(1)
SMUIT 21612	271	(2)
SPIDER 21394	273	(1)
SPI 23750	274	(1)
SPIRIT 21799	275	(1)
STOMP 24193	276	(1)
STUP-IU 21160	277	(1)
SWAT 23855	278	(2)
TEPRIM 21385	280	(1)
TESTART 23683	281	(2)
TESTING 21170	283	(1)
TESTLIB 21216	284	(1)
TRUST 23754	285	(1)
USST 23843	286	(1)
VERA 23732	287	(1)
VERDEST 21712	288	(1)
VISTA 24153	289	(2)
STAR 27378	291	(4)
Index	295