Testing IT : An Off-the-Shelf Software Testing Process

This pragmatic guide provides a testing framework that can be used by all members of staff involved in software development and testing within an organisation to improve the quality and to reduce timescales, effort, and cost. This book covers all aspects of testing, as well as software developed or modified in-house, the modification or extension of existing legacy software systems, as well as software developed on behalf of an organisation by a third party. This framework can be customised to match the particular testing requirements of any particular organisation, and a series of real-world case studies are provided to illustrate how this can be achieved. The book also provides a comprehensive set of standard testing document templates, proformas, and checklists for the reader to use in their testing projects. These items are provided electronically, which allows the reader to customised them to match the particular requirements of their business. Cover......Page 1 Half-title......Page 3 Title......Page 5 Copyright......Page 6 Dedication......Page 7 Contents......Page 9 Foreword......Page 15 Acknowledgments......Page 17 1.1 Purpose of the Book......Page 21 1.3 How to Read This Book......Page 22 1.4 Structure and Content of This Book......Page 23 Part 1 The Traditional Testing Process......Page 25 2.2 The Challenge of Testing......Page 27 2.3 What Is Testing?......Page 28 2.4 Verification and Validation......Page 30 2.6 Testing – The Bottom Line......Page 31 2.7 Additional Information......Page 32 3.1 Introduction......Page 35 3.2.1 Positive and Negative Testing......Page 36 3.2.3 Error Guessing......Page 37 3.2.4 Automated Software Testing......Page 38 3.3.1 Equivalence Partitioning......Page 39 3.3.3 Intrusive Testing......Page 40 3.3.5 State Transition Analysis......Page 41 3.4.1 Configuration/Installation Testing......Page 42 3.4.5 Performance Testing......Page 43 3.4.7 Security Testing......Page 44 3.4.9 Usability Testing......Page 45 3.5 Further Reading on Testing Techniques......Page 46 4.1 Introduction......Page 47 4.2 The Organization of Testing......Page 48 4.3.1 Overview......Page 49 4.3.3 Test Team Leader......Page 50 4.3.4 Test Analyst......Page 51 4.3.6 Independent Test Observer......Page 52 Test Automation Analyst......Page 53 4.4.1 Overview......Page 54 4.4.3 Integration Testing......Page 55 4.4.4 System Testing......Page 56 4.4.5 Systems Integration Testing......Page 57 4.4.7 Regression Testing......Page 58 4.5 Role of the V Model in Planning......Page 59 4.6 The Management of Test Requirements......Page 61 4.8 The Role and Use of Defect Tracking......Page 62 4.9 The Role of Risk in Test Planning and Management......Page 63 5.1 Overview......Page 65 5.3 Unit Test Data Requirements......Page 67 5.4 Roles and Responsibilities......Page 68 5.5 Planning and Resources......Page 69 5.8 Outputs......Page 70 6.1 Overview......Page 73 6.2 Integration Test Approach......Page 74 6.4 Roles and Responsibilities......Page 75 6.5 Planning and Resources......Page 76 6.8 Outputs......Page 77 7.1.Overview......Page 79 7.3.System Test Data Requirements......Page 80 7.4.Roles and Responsibilities......Page 81 7.5 Planning and Resources......Page 82 7.8 Outputs......Page 83 8.1 Overview......Page 85 8.2 Systems Integration Test Approach......Page 86 8.4 Roles and Responsibilities......Page 87 8.5 Planning and Resources......Page 88 8.7 Testing Techniques for Systems Integration Testing......Page 89 8.8 Outputs......Page 90 9.1 Overview......Page 93 9.2 User Acceptance Test Approach......Page 94 9.4 Roles and Responsibilities......Page 95 9.5 Planning and Resources......Page 96 9.6 Inputs......Page 97 9.8 Outputs......Page 98 10.1 Overview......Page 101 10.2 Operations Acceptance Test Approach......Page 102 10.3 Operations Acceptance Test Data Requirements......Page 103 10.4 Roles and Responsibilities......Page 104 10.5 Planning and Resources......Page 105 10.8 Outputs......Page 106 11.1 Overview......Page 109 11.2 Regression Test Approach......Page 110 11.3 Regression Test Data Requirements......Page 111 11.4 Roles and Responsibilities......Page 112 11.5 Planning and Resources......Page 113 11.8 Outputs......Page 114 12.1 Introduction......Page 117 12.2 Overview of the Role and Use of Metrics......Page 118 12.3 Metrics Typically Used within the Testing Process......Page 119 12.4 Setting Up and Administering a Metrics Program......Page 122 12.5 A Proposal for a Simple and Effective Metrics Set......Page 124 12.6 Further Reading......Page 126 13.2.1 Overview......Page 127 13.2.2 Establishing the Requirement......Page 128 13.2.3 Strategy for Introduction and Adoption......Page 129 13.3 Maintenance of the Testing Process......Page 131 Part 2 The Testing Process in the Real World: Illustrative Case Studies......Page 133 British Library......Page 135 Reuters Product Acceptance Group......Page 136 Crown Quality Assurance Group......Page 137 The Wine Society......Page 138 Automatic Data Processing Limited......Page 139 14.2 Characteristics of the Testing Requirement......Page 141 14.3 The Management and Planning of Testing......Page 142 Testing Manager......Page 144 Test Analyst......Page 145 Independent Test Observer......Page 146 14.6 Artifacts......Page 147 14.7 Process Improvement......Page 148 15.1 Overview of the Organization......Page 149 15.2 Testing Requirements......Page 150 15.3 The Management and Planning of Testing......Page 152 15.4 Roles and Responsibilities......Page 153 RDB/GUI Acceptance Managers......Page 154 Test Analyst......Page 155 15.5 Testing Phases......Page 156 Unit, Link, Systems, and Integration Testing......Page 157 Acceptance Testing......Page 158 User Testing......Page 159 15.6 Artifacts......Page 160 15.7 Process Improvement......Page 161 16.1 Overview of the Organization......Page 163 16.2 Testing Requirements......Page 164 16.3 The Management and Planning of Testing......Page 165 QA Team Manager......Page 167 Test Analyst/Tester......Page 168 Client Representative......Page 169 System Testing......Page 170 Acceptance Testing......Page 171 16.6 Artifacts......Page 172 16.7 Process Improvement......Page 173 17.1 Overview of the Organization......Page 175 17.2 Testing Requirements......Page 176 17.3 The Management and Planning of Testing......Page 177 Project Manager......Page 179 Testing Consultant......Page 180 17.5 Testing Phases......Page 181 Regression Testing......Page 182 17.6 Artifacts......Page 183 17.7 Process Improvement......Page 184 18.1 Overview of the Organization......Page 187 18.2 Characteristics of the Testing Requirement......Page 188 18.3 The Management and Planning of Testing......Page 189 18.4 Roles and Responsibilities......Page 191 Development Project Manager......Page 192 QA Analyst......Page 193 18.5 Testing Phases......Page 194 Acceptance Testing......Page 195 Regression Testing......Page 196 18.6 Artifacts......Page 198 18.7 Process Improvement......Page 199 Part 3 The Appendices......Page 201 A.1 Introduction......Page 203 Reporting and Liaison......Page 204 References......Page 205 Reporting and Liaison......Page 206 References......Page 207 Reporting and Liaison......Page 208 Reference......Page 209 Reporting and Liaison......Page 210 Reference......Page 211 Reporting and Liaison......Page 212 References......Page 213 Reporting and Liaison......Page 214 Reference......Page 215 B.1 Introduction......Page 217 Outputs......Page 218 References......Page 219 Outputs......Page 220 References......Page 221 Outputs......Page 222 References......Page 223 Outputs......Page 224 References......Page 225 Outputs......Page 226 References......Page 227 Outputs......Page 228 References......Page 229 C.1 Introduction......Page 231 D.1 Introduction......Page 241 E.1 Introduction......Page 251 F.1 Introduction......Page 257 G.1 Introduction......Page 261 H.1 Introduction......Page 265 I.2 Creating a Re-use Pack......Page 267 I.4 How to Use the Re-use Pack......Page 268 J.1 Introduction......Page 269 K.3 Analyzing the Testing Requirements......Page 275 K.4 Designing the Test Cases......Page 276 L.3 Analyzing the Testing Requirements......Page 277 L.4 Designing the Test Cases......Page 278 M.4 Designing the Test Cases......Page 279 N.2 Scoring Scheme......Page 281 N.4 Support for Testing Management......Page 282 N.5 Tool Technical Issues......Page 283 N.7 Tool Documentation Issues......Page 284 N.8 Tool Integration Issues......Page 285 N.9 Tool Usability Issues......Page 286 N.10 Supplier Issues......Page 287 N.11 Training and Consultancy Issues......Page 288 N.13 Miscellaneous Issues......Page 289 O.2 Roles and Responsibilities......Page 295 O.5 Post-Test Activities......Page 296 P.2 Terminology......Page 299 P.4 Testing Process......Page 300 P.5 Roles and Responsibilities......Page 301 P.6 Testing Phases......Page 302 P.7 Optional Evaluation Scheme......Page 303 Q.2 Object-Oriented Development......Page 307 Iterative Development......Page 309 Rapid Prototyping......Page 310 Q.4 Impact of OO on Test Design......Page 311 Integration Testing......Page 312 Acceptance Testing......Page 313 References......Page 315 Introduction......Page 317 Index......Page 331 "Testing IT provides a complete, off-the-shelf software testing process framework for any testing practitioner who is looking to research, implement, roll out, adopt, and maintain a software testing process. It covers all aspects of testing for software developed or modified in-house, modified or extended legacy systems, and software developed by a third party. Software professionals can customize the framework to match the testing requirements of any organization, and six real-world testing case studies are provided to show how other organizations have done this. Packed with a series of real-world case studies, the book also provides a comprehensive set of downloadable testing document templates, proformas, and checklists to support the process of customizing. This new edition demonstrates the role and use of agile testing best practices and includes a specific agile case study"-- "Testing IT provides a complete, off-the-shelf software testing process framework for any testing practitioner who is looking to research, implement, roll out, adopt, and maintain a software testing process. It covers all aspects of testing for software developed or modified in-house, modified or extended legacy systems, and software developed by a third party. Software professionals can customize the framework to match the testing requirements of any organization, and six realworld testing case studies are provided to show how other organizations have done this. Packed with a series of real-world case studies, the book also provides a comprehensive set of downloadable testing document templates, proformas, and checklists to support the process of customizing. This new edition demonstrates the role and use of agile testing best practices and includes a specific agile case study"-- Annotation This pragmatic guide provides a testing framework for software professionals looking to improve product quality and to reduce timescales, effort, and cost. It covers all aspects of testing for software developed or modified in-house, modified or extended legacy systems, and software developed by a third party. The reader can customize the framework to match the particular testing requirements of any particular organization. Packed with a series of real-world case studies, the book also provides a comprehensive set of standard testing document templates, proformas, and checklists for the reader to use in projects This pragmatic guide provides a testing framework for software professionals looking to improve product quality and to reduce time scales, effort, and cost. Packed with a series of real-world case studies, the book also provides a comprehensive set of standard testing document templates, proformas, and checklists, for the reader to use in projects. These elements are available on the enclosed CD-ROM. 50 line diagrams. This ready-made framework covers all aspects of software testing and can be used by all testing professionals working on software developed in-house, the modification of legacy systems, or third-party software. Includes real-world case studies and a comprehensive set of standard testing document templates in electronic form, for customization This book provides comprehensive and rigorous guidance to workers in the field of software testing for researching or setting up a software testing process within organizations.