Surviving the Top Ten Challenges of Software Testing

by Perry, William E.; Rice, Randall W.

• ISBN13: 9780932633385
• ISBN10: 0932633382
• Format: Paperback
• Copyright: 1997-10-01
• Publisher: Dorset House

Summary

Software testers require people-oriented skills to survive what can often be a lose-lose relationship with developers and managers. Surviving the Top Ten Challenges of Software Testing goes beyond the technical skillsets required for effective testing to address the political realities that can't be solved by technical knowledge alone.Authors Perry and Rice compile a "top ten" list of the challenges faced by testers and offer tactics for success. The challenges illustrate the way testing fits into the context of software development and how testers can manage expectations and improve communication with managers, developers, and customers. The text features a self-assessment for testing skills and an action plan for improving the testing process.Topics include training, acquiring management support, obtaining tools, communicating with customers, managing changing requirements, marketing the importance of testing, testing what's thrown over the wall, controlling the scope of testing, teaching developers to test, and handling the delicate situation of reporting defects.The Top Ten People Challenges Facing TestersChallenge #10: Getting Trained in TestingChallenge #9: Building Relationships with DevelopersChallenge #8: Testing Without ToolsChallenge #7: Explaining Testing to ManagersChallenge #6: Communicating with Customers -- And UsersChallenge #5: Making Time for TestingChallenge #4: Testing What's Thrown Over the WallChallenge #3: Hitting a Moving TargetChallenge #2: Fighting a Lose-Lose SituationChallenge #1: Having to Say No

Table of Contents

CHAPTER ONE HOW TESTING TESTS TESTERS	1	(12)
THE TESTER'S WORLD	2	(1)
TESTER 1 VERSUS TESTER 2	3	(1)
THE ROOT CAUSE OF THE TESTER'S PEOPLE CHALLENGE	4	(3)
THE TOP TEN PEOPLE-RELATED CHALLENGES	7	(4)
ROAD MAP THROUGH THE BOOK	11	(2)
CHAPTER TWO DOES TESTING TEST YOU?	13	(12)
WHY DO A SELF-ASSESSMENT?	13	(1)
THE THREE NECESSARY INGREDIENTS FOR SUCCESS	14	(1)
SELF-ASSESSMENT INSTRUCTIONS	15	(1)
SUMMARIZING THE SELF-ASSESSMENT RESULTS	16	(6)
INTERPRETING SELF-ASSESSMENT RESULTS	22	(3)
Conclusion 1: Overall Assessment	22	(2)
Conclusion 2: Criterion Assessment	24	(1)
CHAPTER THREE CHALLENGE #10: GETTING TRAINED IN TESTING	25	(20)
OVERVIEW	25	(1)
STATE OF THE PRACTICE	26	(1)
What Went Wrong in This Scenario?	26	(1)
IMPACT ON TESTING	27	(9)
Skill Categories and Descriptions	28	(1)
Knowing What Kinds of Testing Should Be Performed	29	(7)
SOLUTIONS TO THE CHALLENGE	36	(5)
Raise Management Awareness of Testing	36	(2)
Make Time for Training	38	(1)
Develop Your Own Skills	38	(3)
Certify Your Testing Skills	41	(1)
SOLUTION IMPEDIMENTS	41	(1)
GUIDELINES FOR SUCCESS	42	(1)
PLAN OF ACTION	43	(2)
CHAPTER FOUR CHALLENGE #9: BUILDING RELATIONSHIPS WITH DEVELOPERS	45	(12)
OVERVIEW	45	(1)
STATE OF THE PRACTICE	45	(2)
IMPACT ON TESTING	47	(4)
The Impact on Testing Progress	48	(1)
The Impact on Group Morale	49	(2)
SOLUTIONS TO THE CHALLENGE	51	(2)
Adopt a Win-Win Approach	51	(1)
Widen Your View of Testing	52	(1)
Move from "Us versus Them" to "Us and Them"	52	(1)
SOLUTION IMPEDIMENTS	53	(2)
GUIDELINES FOR SUCCESS	55	(1)
PLAN OF ACTION	56	(1)
CHAPTER FIVE CHALLENGE #8: TESTING WITHOUT TOOLS	57	(18)
OVERVIEW	57	(1)
STATE OF THE PRACTICE	58	(1)
IMPACT ON TESTING	59	(7)
SOLUTIONS TO THE CHALLENGE	66	(4)
Educate Management on the Use of Test Tools	66	(2)
Perform a Tool Survey	68	(1)
Define Your Requirements	68	(1)
Perform a Cost/Benefit Analysis	69	(1)
Investigate Tools Available	69	(1)
Integrate Test Tools with an Effective Testing Process	70	(1)
SOLUTION IMPEDIMENTS	70	(1)
GUIDELINES FOR SUCCESS	71	(2)
PLAN OF ACTION	73	(2)
CHAPTER SIX CHALLENGE #7: EXPLAINING TESTING TO MANAGERS	75	(17)
OVERVIEW	75	(1)
STATE OF THE PRACTICE	76	(1)
IMPACT ON TESTING	77	(5)
An Unsupportive View of Test Management	78	(3)
A Strategic View of Test Management	81	(1)
SOLUTIONS TO THE CHALLENGE	82	(6)
Identify the Stakeholders at the Management Level	84	(1)
Raise Awareness of the Testing Function	85	(1)
Network with Other Organizations to Learn How They Deal with Management	85	(1)
Establish a Testing Charter to Define the Purpose of Testing in Your Organization	86	(1)
Define Measurable Testing Objectives	86	(1)
Dedicate a Manager of Testing Who Understands the Issues and Challenges	86	(2)
Make Testing a Process	88	(1)
SOLUTION IMPEDIMENTS	88	(1)
GUIDELINES FOR SUCCESS	89	(1)
PLAN OF ACTION	90	(2)
CHAPTER SEVEN CHALLENGE #6: COMMUNICATING WITH CUSTOMERS--AND USERS	92	(15)
OVERVIEW	92	(1)
STATE OF THE PRACTICE	93	(1)
IMPACT ON TESTING	94	(2)
SOLUTIONS TO THE CHALLENGE	96	(8)
Teamwork	98	(1)
Communication	98	(3)
Continuous Involvement	101	(3)
SOLUTION IMPEDIMENTS	104	(1)
GUIDELINES FOR SUCCESS	105	(1)
PLAN OF ACTION	106	(1)
CHAPTER EIGHT CHALLENGE #5: MAKING TIME FOR TESTING	107	(15)
OVERVIEW	107	(1)
STATE OF THE PRACTICE	108	(3)
IMPACT ON TESTING	111	(3)
Reduced Test Coverage	112	(1)
Increased Risk of Regression Defects	112	(1)
Fatigue, Burnout, and Low Morale	113	(1)
SOLUTIONS TO THE CHALLENGE	114	(3)
Control the Scope of Testing	114	(1)
Control Management Expectations	114	(1)
Base Test Cases on an Independent Set of Criteria	114	(1)
Perform Risk Assessments	115	(1)
Reuse Your Testware	115	(1)
Estimate the Testing Effort Based on Measurable Criteria	116	(1)
Use Automation	116	(1)
SOLUTION IMPEDIMENTS	117	(2)
GUIDELINES FOR SUCCESS	119	(2)
PLAN OF ACTION	121	(1)
CHAPTER NINE CHALLENGE #4: TESTING WHAT'S THROWN OVER THE WALL	122	(11)
OVERVIEW	122	(1)
STATE OF THE PRACTICE	123	(2)
IMPACT ON TESTING	125	(1)
SOLUTIONS TO THE CHALLENGE	126	(4)
Get Management Support to Define Roles and Responsibilities	126	(1)
Establish Standards and Processes for Testing	126	(2)
Establish Ownership and Accountability at the Developer Level	128	(1)
Train Developers to Be Excellent Testers	128	(1)
Improve Communication Between Developers and Testers	129	(1)
Measure and Refine the Processes Continually	129	(1)
Establish Ground Rules	130	(1)
SOLUTION IMPEDIMENTS	130	(1)
GUIDELINES FOR SUCCESS	131	(1)
PLAN OF ACTION	132	(1)
CHAPTER TEN CHALLENGE #3: HITTING A MOVING TARGET	133	(16)
OVERVIEW	133	(1)
STATE OF THE PRACTICE	134	(2)
IMPACT ON TESTING	136	(1)
SOLUTIONS TO THE CHALLENGE	137	(7)
Rework of Testware	138	(1)
Regression Testing of Previously Tested Software	139	(4)
Backlog Created by Rapid Change	143	(1)
SOLUTION IMPEDIMENTS	144	(2)
GUIDELINES FOR SUCCESS	146	(1)
PLAN OF ACTION	147	(2)
CHAPTER ELEVEN CHALLENGE #2: FIGHTING A LOSE-LOSE SITUATION	149	(12)
OVERVIEW	149	(1)
STATE OF THE PRACTICE	149	(3)
IMPACT ON TESTING	152	(2)
Keeping an Organization at a Low Level of Process Maturity	152	(1)
Trivializing and Undermining the Testing Process	152	(1)
Demoralizing Testers	153	(1)
Fostering a False View of Testing	153	(1)
SOLUTIONS TO THE CHALLENGE	154	(3)
Communicate the Role of Testing to the Rest of the Organization	154	(1)
Identify What Testers Can Reasonably Accomplish	154	(1)
Set and Manage Customer Expectations of Production Software	155	(2)
SOLUTION IMPEDIMENTS	157	(1)
GUIDELINES FOR SUCCESS	158	(1)
PLAN OF ACTION	159	(2)
CHAPTER TWELVE CHALLENGE #1: HAVING TO SAY NO	161	(14)
OVERVIEW	161	(1)
STATE OF THE PRACTICE	162	(1)
IMPACT ON TESTING	163	(2)
Test Reporting Is Your Friend!	165	(1)
SOLUTIONS TO THE CHALLENGE	165	(6)
Standardize Test Reports	165	(1)
Make Test Reporting Part of the Testing Process	166	(1)
Manage Your Audience's Expectations	166	(2)
Use Creative Reporting Techniques	168	(1)
Focus on the Facts	168	(1)
Be Truthful	168	(1)
Document Your Tests	169	(1)
Build a Mature Culture	170	(1)
SOLUTION IMPEDIMENTS	171	(1)
GUIDELINES FOR SUCCESS	172	(1)
PLAN OF ACTION	173	(2)
CHAPTER THIRTEEN PLAN OF ACTION TO IMPROVE TESTING	175	(16)
BUILD THE WILL TO IMPROVE	176	(2)
USE THE WAY TO CHANGE THE TESTING PROCESS	178	(11)
Step 1: What Needs to Be Changed	180	(2)
Step 2: How Much Change (The Goal)	182	(1)
Step 3: How to Make the Change (The Plan)	183	(1)
Step 4: How to Build Support	183	(3)
Step 5: How to Monitor and Measure the Change	186	(2)
Step 6: How to Reward Participants	188	(1)
TESTING IMPROVEMENT IS A NEVER-ENDING PROCESS	189	(2)
RESOURCES	191	(4)
RELATED READING	191	(1)
CERTIFICATION PROGRAMS FOR SOFTWARE TESTING	192	(1)
LOCAL QUALITY ASSURANCE GROUPS	192	(3)
INDEX	195