Cover image for Hard Problems in Software Testing

Hard Problems in Software Testing

Author Brianna Floss , Scott Tilley
Release Date: 2014/09/01
ISBN: 9781627055239
Topic:
0%
24
Chapters
0-1
Hours read
0k
Total Words
    Start Reading Now    
       Add to Wishlist       
View table of contents

Book Description

This book summarizes the current hard problems in software testing as voiced by leading practitioners in the field. The problems were identified through a series of workshops, interviews, and surveys. Some of the problems are timeless, such as education and training, while others such as system security have recently emerged as increasingly important. The book also provides an overview of the current state of Testing as a Service (TaaS) based on an exploration of existing commercial offerings and a survey of academic research. TaaS is a relatively new development that offers software testers the elastic computing capabilities and generous storage capacity of the cloud on an as-needed basis. Some of the potential benefits of TaaS include automated provisioning of test execution environments and support for rapid feedback in agile development via continuous regression testing. The book includes a case study of a representative web application and three commercial TaaS tools to determine which hard problems in software testing are amenable to a TaaS solution. The findings suggest there remains a significant gap that must be addressed before TaaS can be fully embraced by the industry, particularly in the areas of tester education and training and a need for tools supporting more types of testing. The book includes a roadmap for enhancing TaaS to help bridge the gap between potential benefits and actual results. Table of Contents: Introduction / Hard Problems in Software Testing / Testing as a Service (TaaS) / Case Study and Gap Analysis / Summary / Appendix A: Hard Problems in Software Testing Survey / Appendix B: Google App Engine Code Examples / Appendix C: Sauce Labs Code Examples / References / Author Biographies

Table of Contents

  1. Cover
  2. Copyright
  3. Title Page
  4. Contents
  5. Figures
  6. Tables
  7. Foreword
  8. Preface
  9. Acknowledgments
  10. Dedication
  11. List of Abbreviations
  12. 1 Introduction
    1. 1.1 Software Testing Challenges
    2. 1.2 Service-Oriented Solutions
    3. 1.3 Gap Analysis Between HPST and TaaS
  13. 2 Hard Problems in Software Testing
    1. 2.1 The HPST Survey
    2. 2.2 Survey Results
      1. 2.2.1 Software Testing Problems
      2. 2.2.2 Topics for the Research Community
    3. 2.3 Discussion of Results
      1. 2.3.1 Software Testing Problems
      2. 2.3.2 Topics for the Research Community
  14. 3 Testing as a Service (TaaS)
    1. 3.1 Key Components of TaaS
      1. 3.1.1 Cloud Computing
      2. 3.1.2 Service-Oriented Architecture
      3. 3.1.3 Testing as a Service (TaaS)
    2. 3.2 Academic State of TaaS
      1. 3.2.1 Architecture
      2. 3.2.2 Types of Testing
      3. 3.2.3 Case Studies and Experiments
      4. 3.2.4 Benefits, Challenges, and Needs
      5. 3.2.5 Other Research
    3. 3.3 Commercial State of TaaS
      1. 3.3.1 Types of Testing
      2. 3.3.2 Product Features
  15. 4 Case Study and Gap Analysis
    1. 4.1 TaaS Tools
      1. 4.1.1 Sauce Labs (Sauce OnDemand)
      2. 4.1.2 SOASTA CloudTest Lite
      3. 4.1.3 BlazeMeter
    2. 4.2 Case Study
      1. 4.2.1 Objectives
      2. 4.2.2 Hypothesis
      3. 4.2.3 System Under Test
      4. 4.2.4 Analysis of Tools
      5. 4.2.5 Results Overview
      6. 4.2.6 Threats to Validity
    3. 4.3 Gap Analysis
      1. 4.3.1 Unsatisfied Hard Problems
      2. 4.3.2 Caveats
      3. 4.3.3 Additional Concerns
  16. 5 Summary
    1. 5.1 Summary of Results
      1. 5.1.1 Research Objectives
      2. 5.1.2 Research Contributions
    2. 5.2 Future Work
    3. 5.3 Concluding Remarks
  17. Appendix A: Hard Problems in Software Testing Survey
  18. Appendix B: Google App Engine Code Examples
  19. Appendix C: Sauce Labs Code Examples
  20. References
  21. Author Biographies
18.117.232.239