Contents

Preface

Acknowledgments

About the Author

Chapter 1: What’s Special about Mobile Testing?

User Expectations

Mobility and Data Networks

Mobile Devices

Mobile Release Cycles

Mobile Testing Is Software Testing

Summary

Chapter 2: Introduction to Mobile Devices and Apps

Overview of Mobile Networks

Mobile Devices and the Year 2007

The Big Two

What Types of Apps Exist?

Native Apps

Hybrid Apps

Web Apps

Business Models of Mobile Apps

Freemium

Paid

Transaction

Choosing a Business Model

App Stores

Summary

Chapter 3: Challenges in Mobile Testing

The Customer

Customer Summary

Mobile Platforms and Fragmentation

Mobile Device Groups

Mobile Device Labs

Sensors and Interfaces

Ambient Light Sensor

Proximity Sensor

Acceleration Sensor

Gyroscope Sensor

Magnetic Sensor

Pressure, Temperature, and Humidity Sensors

Location Sensor

Touchless Sensor

Sensors Summary

Touchscreen

Microphones

Camera

System Apps

Internationalization (I18n) and Localization (L10n)

Mobile Browsers

Summary

Chapter 4: How to Test Mobile Apps

Emulator, Simulator, or Real Device?

Manual Testing versus Automated Testing

“Traditional” Testing

Mobile-Specific Testing

Mobile Functional Testing

Mobile Usability Testing

Accessibility Testing

Battery Usage Testing

Stress and Interrupt Testing

Performance Testing

Standby Testing

Installation Testing

Update Testing

Database Testing

Local Storage Testing

Security Testing

Platform Guideline Testing

Conformance Testing

Checking the Log Files

Be Creative!

Checklists, Mnemonics, and Mind Maps

Checklists

Mnemonics

Mind Maps

How to File Mobile Bugs

Bug ID

Description

Steps to Reproduce

Expected Result

Actual Result

Work-around

Reproducible

Operating System, Mobile Platform, and Mobile Device

Mobile-Device-Specific Information

Browser Version

Software Build Version

Network Condition and Environment

Language

Test Data

Severity

Bug Category

Screenshot or Video

Log Files

Tester Who Found the Bug

Three More Points

App Quality Alliance

Summary

Chapter 5: Mobile Test Automation and Tools

The Flipped Testing Pyramid

The Mobile Test Pyramid

Different Types of Test Automation Tools

Image Recognition

Coordinate-Based Recognition

OCR/Text Recognition

Native Object Recognition

Capture and Replay

Tool Type Recommendation

What Should Be Automated?

Emulator, Simulator, or Real Device?

Emulator/Simulator Pros

Emulator/Simulator Cons

Real Device Pros

Real Device Cons

Where to Automate?

How to Select the Right Mobile Test Automation Tool

Selection Criteria for a Test Automation Tool

Current State of Tools

Android Tools

iOS Tools

Mobile Test Automation Tools Summary

Continuous Integration System

Beta Distribution Tools

Summary

Chapter 6: Additional Mobile Testing Methods

Crowd Testing

Private Crowd Testing

Mobile Cloud Testing

Private Cloud

Cloud-Based Test Automation

Summary

Chapter 7: Mobile Test and Launch Strategies

Mobile Test Strategy

Define Requirements

Testing Scope

Define Test Levels and Test Techniques

Test Data

Select Target Devices and Test Environment

Manual and in-the-Wild Testing

Mobile Checklists and Tours

Test Automation

Product Risks

Mobile Launch Strategy

Pre-Launch—Check the Release Material

Post-Release—What Happens after an App Launch?

Community Support

Reviews

Crash Reports

Tracking and Statistics

Summary

Chapter 8: Important Skills for Mobile Testers

Skill Set of a Mobile Tester

Communication

Curiosity

Critical Thinking

Tenacity

Constant Learner

Creativity

Customer Focus

Programming and Technical Skills

How to Improve Your Mobile Testing Skills

Learn from Other Apps

Crashes on Specific Devices

Observe

Take Part in Competitions and Test Cycles

The Mobile Community and the Mobile World

Valuable Sources

Summary

Chapter 9: What’s Next? And Final Thoughts

Internet of Things

Connected Home

Connected Car

Wearables

Smart Watches and Fitness Wristbands

Smart Glasses

Health Apps

Final Thoughts

Five Key Success Factors

Summary

Index